2023-10-29 15:52:41,780 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-10-29 15:52:41,997 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2 2023-10-29 15:52:42,009 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-10-29 15:52:42,010 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/cluster_89962ca0-ab74-9933-047b-7d7164e2e3b8, deleteOnExit=true 2023-10-29 15:52:42,010 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-10-29 15:52:42,010 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/test.cache.data in system properties and HBase conf 2023-10-29 15:52:42,011 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/hadoop.tmp.dir in system properties and HBase conf 2023-10-29 15:52:42,011 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/hadoop.log.dir in system properties and HBase conf 2023-10-29 15:52:42,012 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/mapreduce.cluster.local.dir in system properties and HBase conf 2023-10-29 15:52:42,012 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-10-29 15:52:42,012 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-10-29 15:52:42,121 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-10-29 15:52:42,474 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-10-29 15:52:42,479 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-10-29 15:52:42,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-10-29 15:52:42,480 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-10-29 15:52:42,481 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-29 15:52:42,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-10-29 15:52:42,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-10-29 15:52:42,482 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-10-29 15:52:42,483 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-29 15:52:42,483 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-10-29 15:52:42,483 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/nfs.dump.dir in system properties and HBase conf 2023-10-29 15:52:42,484 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/java.io.tmpdir in system properties and HBase conf 2023-10-29 15:52:42,484 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/dfs.journalnode.edits.dir in system properties and HBase conf 2023-10-29 15:52:42,485 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-10-29 15:52:42,485 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-10-29 15:52:43,050 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-29 15:52:43,056 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-29 15:52:43,726 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-10-29 15:52:43,900 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-10-29 15:52:43,920 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-29 15:52:43,959 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-10-29 15:52:43,989 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/java.io.tmpdir/Jetty_localhost_41669_hdfs____61c1hi/webapp 2023-10-29 15:52:44,114 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41669 2023-10-29 15:52:44,123 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-10-29 15:52:44,124 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-10-29 15:52:44,527 WARN [Listener at localhost/44937] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-29 15:52:44,589 WARN [Listener at localhost/44937] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-10-29 15:52:44,608 WARN [Listener at localhost/44937] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-10-29 15:52:44,617 INFO [Listener at localhost/44937] log.Slf4jLog(67): jetty-6.1.26 2023-10-29 15:52:44,631 INFO [Listener at localhost/44937] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/java.io.tmpdir/Jetty_localhost_39545_datanode____.i9y8cp/webapp 2023-10-29 15:52:44,739 INFO [Listener at localhost/44937] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39545 2023-10-29 15:52:45,090 WARN [Listener at localhost/37167] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-10-29 15:52:45,668 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb08560082466e129: Processing first storage report for DS-939b4282-ad98-4145-8a96-ac22873b3ca1 from datanode 1bb2a12f-1539-4cd2-bd35-c979942b51b6 2023-10-29 15:52:45,670 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb08560082466e129: from storage DS-939b4282-ad98-4145-8a96-ac22873b3ca1 node DatanodeRegistration(127.0.0.1:39799, datanodeUuid=1bb2a12f-1539-4cd2-bd35-c979942b51b6, infoPort=44151, infoSecurePort=0, ipcPort=37167, storageInfo=lv=-57;cid=testClusterID;nsid=83671017;c=1698594763118), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-10-29 15:52:45,670 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb08560082466e129: Processing first storage report for DS-36971fcc-6ae0-4544-a6f7-dc05abffbde7 from datanode 1bb2a12f-1539-4cd2-bd35-c979942b51b6 2023-10-29 15:52:45,670 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb08560082466e129: from storage DS-36971fcc-6ae0-4544-a6f7-dc05abffbde7 node DatanodeRegistration(127.0.0.1:39799, datanodeUuid=1bb2a12f-1539-4cd2-bd35-c979942b51b6, infoPort=44151, infoSecurePort=0, ipcPort=37167, storageInfo=lv=-57;cid=testClusterID;nsid=83671017;c=1698594763118), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-10-29 15:52:45,757 DEBUG [Listener at localhost/37167] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2 2023-10-29 15:52:45,815 INFO [Listener at localhost/37167] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/cluster_89962ca0-ab74-9933-047b-7d7164e2e3b8/zookeeper_0, clientPort=62629, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/cluster_89962ca0-ab74-9933-047b-7d7164e2e3b8/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/cluster_89962ca0-ab74-9933-047b-7d7164e2e3b8/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-10-29 15:52:45,831 INFO [Listener at localhost/37167] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62629 2023-10-29 15:52:45,841 INFO [Listener at localhost/37167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:52:45,844 INFO [Listener at localhost/37167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:52:46,508 INFO [Listener at localhost/37167] util.FSUtils(471): Created version file at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc with version=8 2023-10-29 15:52:46,508 INFO [Listener at localhost/37167] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/hbase-staging 2023-10-29 15:52:46,780 INFO [Listener at localhost/37167] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-10-29 15:52:47,159 INFO [Listener at localhost/37167] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=3 2023-10-29 15:52:47,185 INFO [Listener at localhost/37167] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 15:52:47,186 INFO [Listener at localhost/37167] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-29 15:52:47,186 INFO [Listener at localhost/37167] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-29 15:52:47,186 INFO [Listener at localhost/37167] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 15:52:47,186 INFO [Listener at localhost/37167] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-29 15:52:47,307 INFO [Listener at localhost/37167] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-10-29 15:52:47,393 DEBUG [Listener at localhost/37167] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-10-29 15:52:47,469 INFO [Listener at localhost/37167] ipc.NettyRpcServer(120): Bind to /148.251.75.209:46089 2023-10-29 15:52:47,477 INFO [Listener at localhost/37167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:52:47,479 INFO [Listener at localhost/37167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:52:47,501 INFO [Listener at localhost/37167] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46089 connecting to ZooKeeper ensemble=127.0.0.1:62629 2023-10-29 15:52:47,533 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:460890x0, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-29 15:52:47,536 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46089-0x1017e660d0e0000 connected 2023-10-29 15:52:47,562 DEBUG [Listener at localhost/37167] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 15:52:47,563 DEBUG [Listener at localhost/37167] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 15:52:47,567 DEBUG [Listener at localhost/37167] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-29 15:52:47,576 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46089 2023-10-29 15:52:47,576 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46089 2023-10-29 15:52:47,577 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46089 2023-10-29 15:52:47,578 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46089 2023-10-29 15:52:47,579 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46089 2023-10-29 15:52:47,585 INFO [Listener at localhost/37167] master.HMaster(444): hbase.rootdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc, hbase.cluster.distributed=false 2023-10-29 15:52:47,651 INFO [Listener at localhost/37167] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=3 2023-10-29 15:52:47,652 INFO [Listener at localhost/37167] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 15:52:47,652 INFO [Listener at localhost/37167] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-10-29 15:52:47,652 INFO [Listener at localhost/37167] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-10-29 15:52:47,652 INFO [Listener at localhost/37167] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-10-29 15:52:47,652 INFO [Listener at localhost/37167] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-10-29 15:52:47,657 INFO [Listener at localhost/37167] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-10-29 15:52:47,664 INFO [Listener at localhost/37167] ipc.NettyRpcServer(120): Bind to /148.251.75.209:44603 2023-10-29 15:52:47,667 INFO [Listener at localhost/37167] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-10-29 15:52:47,677 DEBUG [Listener at localhost/37167] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-10-29 15:52:47,678 INFO [Listener at localhost/37167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:52:47,681 INFO [Listener at localhost/37167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:52:47,683 INFO [Listener at localhost/37167] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44603 connecting to ZooKeeper ensemble=127.0.0.1:62629 2023-10-29 15:52:47,687 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:446030x0, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-10-29 15:52:47,693 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44603-0x1017e660d0e0001 connected 2023-10-29 15:52:47,693 DEBUG [Listener at localhost/37167] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 15:52:47,696 DEBUG [Listener at localhost/37167] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 15:52:47,698 DEBUG [Listener at localhost/37167] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-10-29 15:52:47,704 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44603 2023-10-29 15:52:47,708 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44603 2023-10-29 15:52:47,709 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44603 2023-10-29 15:52:47,710 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44603 2023-10-29 15:52:47,710 DEBUG [Listener at localhost/37167] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44603 2023-10-29 15:52:47,713 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:52:47,721 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-29 15:52:47,722 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:52:47,738 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-29 15:52:47,738 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-10-29 15:52:47,738 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:52:47,739 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-29 15:52:47,740 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,46089,1698594766633 from backup master directory 2023-10-29 15:52:47,740 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-10-29 15:52:47,743 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:52:47,743 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-10-29 15:52:47,744 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-29 15:52:47,744 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:52:47,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-10-29 15:52:47,748 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-10-29 15:52:47,822 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/hbase.id with ID: 816b9795-9a26-4d53-b5f4-f4ab494e4ae8 2023-10-29 15:52:47,864 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:52:47,881 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:52:47,922 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x2be02304 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:52:47,953 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d2efbdf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:52:47,975 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-10-29 15:52:47,977 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-10-29 15:52:47,990 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-10-29 15:52:47,990 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-10-29 15:52:47,992 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-29 15:52:47,995 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-10-29 15:52:47,996 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 15:52:48,025 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store-tmp 2023-10-29 15:52:48,453 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:52:48,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-29 15:52:48,454 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 15:52:48,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 15:52:48,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-29 15:52:48,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 15:52:48,454 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 15:52:48,454 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 15:52:48,456 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/WALs/jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:52:48,483 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C46089%2C1698594766633, suffix=, logDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/WALs/jenkins-hbase20.apache.org,46089,1698594766633, archiveDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/oldWALs, maxLogs=10 2023-10-29 15:52:48,549 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39799,DS-939b4282-ad98-4145-8a96-ac22873b3ca1,DISK] 2023-10-29 15:52:48,557 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-10-29 15:52:48,616 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/WALs/jenkins-hbase20.apache.org,46089,1698594766633/jenkins-hbase20.apache.org%2C46089%2C1698594766633.1698594768494 2023-10-29 15:52:48,617 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39799,DS-939b4282-ad98-4145-8a96-ac22873b3ca1,DISK]] 2023-10-29 15:52:48,617 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:52:48,617 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:52:48,621 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 15:52:48,622 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 15:52:48,682 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-10-29 15:52:48,692 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-10-29 15:52:48,714 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-10-29 15:52:48,725 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:48,732 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-29 15:52:48,734 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-10-29 15:52:48,749 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-10-29 15:52:48,758 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:52:48,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61868158, jitterRate=-0.07809260487556458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:52:48,760 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 15:52:48,761 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-10-29 15:52:48,779 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-10-29 15:52:48,779 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-10-29 15:52:48,781 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-10-29 15:52:48,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-10-29 15:52:48,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 28 msec 2023-10-29 15:52:48,812 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-10-29 15:52:48,834 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-10-29 15:52:48,839 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-10-29 15:52:48,865 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-10-29 15:52:48,869 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-10-29 15:52:48,872 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-10-29 15:52:48,877 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-10-29 15:52:48,882 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-10-29 15:52:49,026 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:52:49,028 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-10-29 15:52:49,028 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-10-29 15:52:49,039 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-10-29 15:52:49,060 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-29 15:52:49,060 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-10-29 15:52:49,060 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:52:49,061 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,46089,1698594766633, sessionid=0x1017e660d0e0000, setting cluster-up flag (Was=false) 2023-10-29 15:52:49,074 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:52:49,078 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-10-29 15:52:49,079 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:52:49,083 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:52:49,087 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-10-29 15:52:49,088 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:52:49,091 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp 2023-10-29 15:52:49,115 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(951): ClusterId : 816b9795-9a26-4d53-b5f4-f4ab494e4ae8 2023-10-29 15:52:49,119 DEBUG [RS:0;jenkins-hbase20:44603] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-10-29 15:52:49,123 DEBUG [RS:0;jenkins-hbase20:44603] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-10-29 15:52:49,123 DEBUG [RS:0;jenkins-hbase20:44603] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-10-29 15:52:49,126 DEBUG [RS:0;jenkins-hbase20:44603] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-10-29 15:52:49,129 DEBUG [RS:0;jenkins-hbase20:44603] zookeeper.ReadOnlyZKClient(139): Connect 0x40e2b448 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:52:49,139 DEBUG [RS:0;jenkins-hbase20:44603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e254224, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:52:49,140 DEBUG [RS:0;jenkins-hbase20:44603] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4a1adf38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-29 15:52:49,161 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:44603 2023-10-29 15:52:49,164 INFO [RS:0;jenkins-hbase20:44603] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-10-29 15:52:49,165 INFO [RS:0;jenkins-hbase20:44603] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-10-29 15:52:49,165 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1022): About to register with Master. 2023-10-29 15:52:49,167 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,46089,1698594766633 with isa=jenkins-hbase20.apache.org/148.251.75.209:44603, startcode=1698594767651 2023-10-29 15:52:49,185 DEBUG [RS:0;jenkins-hbase20:44603] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-10-29 15:52:49,220 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-10-29 15:52:49,230 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-29 15:52:49,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-29 15:52:49,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-29 15:52:49,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-10-29 15:52:49,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-10-29 15:52:49,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-29 15:52:49,232 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,236 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57657, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-10-29 15:52:49,237 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1698594799236 2023-10-29 15:52:49,239 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-10-29 15:52:49,243 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-10-29 15:52:49,243 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-10-29 15:52:49,245 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46089] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-10-29 15:52:49,248 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-29 15:52:49,252 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-10-29 15:52:49,258 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-10-29 15:52:49,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-10-29 15:52:49,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-10-29 15:52:49,259 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-10-29 15:52:49,262 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,264 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-10-29 15:52:49,266 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-10-29 15:52:49,267 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-10-29 15:52:49,270 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-10-29 15:52:49,271 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-10-29 15:52:49,275 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698594769272,5,FailOnTimeoutGroup] 2023-10-29 15:52:49,275 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698594769275,5,FailOnTimeoutGroup] 2023-10-29 15:52:49,275 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,276 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-10-29 15:52:49,277 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,278 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,288 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(2830): Master is not running yet 2023-10-29 15:52:49,288 WARN [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-10-29 15:52:49,291 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-29 15:52:49,292 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-10-29 15:52:49,292 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc 2023-10-29 15:52:49,313 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:52:49,319 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-29 15:52:49,323 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/info 2023-10-29 15:52:49,324 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-29 15:52:49,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:49,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-29 15:52:49,330 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/rep_barrier 2023-10-29 15:52:49,331 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-29 15:52:49,332 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:49,332 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-29 15:52:49,335 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/table 2023-10-29 15:52:49,336 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-29 15:52:49,337 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:49,339 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740 2023-10-29 15:52:49,340 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740 2023-10-29 15:52:49,345 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-29 15:52:49,348 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-29 15:52:49,352 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:52:49,353 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63888293, jitterRate=-0.04799024760723114}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-29 15:52:49,353 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-29 15:52:49,353 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-29 15:52:49,353 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-29 15:52:49,353 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-29 15:52:49,353 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-29 15:52:49,353 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-29 15:52:49,354 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-29 15:52:49,355 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-29 15:52:49,363 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-10-29 15:52:49,363 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-10-29 15:52:49,373 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-10-29 15:52:49,386 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-10-29 15:52:49,389 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-10-29 15:52:49,389 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,46089,1698594766633 with isa=jenkins-hbase20.apache.org/148.251.75.209:44603, startcode=1698594767651 2023-10-29 15:52:49,394 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46089] master.ServerManager(388): Registering regionserver=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:49,400 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc 2023-10-29 15:52:49,400 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:44937 2023-10-29 15:52:49,400 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-10-29 15:52:49,404 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 15:52:49,405 DEBUG [RS:0;jenkins-hbase20:44603] zookeeper.ZKUtil(162): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:49,406 WARN [RS:0;jenkins-hbase20:44603] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-10-29 15:52:49,406 INFO [RS:0;jenkins-hbase20:44603] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 15:52:49,407 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1948): logDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/WALs/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:49,407 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,44603,1698594767651] 2023-10-29 15:52:49,418 DEBUG [RS:0;jenkins-hbase20:44603] zookeeper.ZKUtil(162): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:49,430 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-10-29 15:52:49,440 INFO [RS:0;jenkins-hbase20:44603] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-10-29 15:52:49,466 INFO [RS:0;jenkins-hbase20:44603] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-10-29 15:52:49,470 INFO [RS:0;jenkins-hbase20:44603] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:52:49,471 INFO [RS:0;jenkins-hbase20:44603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,472 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-10-29 15:52:49,480 INFO [RS:0;jenkins-hbase20:44603] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,480 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,480 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,481 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,481 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,481 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,481 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-10-29 15:52:49,482 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,482 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,482 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,482 DEBUG [RS:0;jenkins-hbase20:44603] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-10-29 15:52:49,483 INFO [RS:0;jenkins-hbase20:44603] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,483 INFO [RS:0;jenkins-hbase20:44603] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,483 INFO [RS:0;jenkins-hbase20:44603] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,498 INFO [RS:0;jenkins-hbase20:44603] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-10-29 15:52:49,500 INFO [RS:0;jenkins-hbase20:44603] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,44603,1698594767651-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:49,518 INFO [RS:0;jenkins-hbase20:44603] regionserver.Replication(203): jenkins-hbase20.apache.org,44603,1698594767651 started 2023-10-29 15:52:49,518 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,44603,1698594767651, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:44603, sessionid=0x1017e660d0e0001 2023-10-29 15:52:49,518 DEBUG [RS:0;jenkins-hbase20:44603] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-10-29 15:52:49,518 DEBUG [RS:0;jenkins-hbase20:44603] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:49,518 DEBUG [RS:0;jenkins-hbase20:44603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44603,1698594767651' 2023-10-29 15:52:49,519 DEBUG [RS:0;jenkins-hbase20:44603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:49,519 DEBUG [RS:0;jenkins-hbase20:44603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:49,520 DEBUG [RS:0;jenkins-hbase20:44603] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-10-29 15:52:49,520 DEBUG [RS:0;jenkins-hbase20:44603] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-10-29 15:52:49,520 DEBUG [RS:0;jenkins-hbase20:44603] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:49,520 DEBUG [RS:0;jenkins-hbase20:44603] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,44603,1698594767651' 2023-10-29 15:52:49,520 DEBUG [RS:0;jenkins-hbase20:44603] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 15:52:49,521 DEBUG [RS:0;jenkins-hbase20:44603] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 15:52:49,521 DEBUG [RS:0;jenkins-hbase20:44603] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-10-29 15:52:49,521 INFO [RS:0;jenkins-hbase20:44603] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-10-29 15:52:49,521 INFO [RS:0;jenkins-hbase20:44603] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-10-29 15:52:49,540 DEBUG [jenkins-hbase20:46089] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-10-29 15:52:49,543 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44603,1698594767651, state=OPENING 2023-10-29 15:52:49,548 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-10-29 15:52:49,549 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:52:49,550 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-29 15:52:49,553 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:52:49,635 INFO [RS:0;jenkins-hbase20:44603] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44603%2C1698594767651, suffix=, logDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/WALs/jenkins-hbase20.apache.org,44603,1698594767651, archiveDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/oldWALs, maxLogs=32 2023-10-29 15:52:49,657 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39799,DS-939b4282-ad98-4145-8a96-ac22873b3ca1,DISK] 2023-10-29 15:52:49,662 INFO [RS:0;jenkins-hbase20:44603] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/WALs/jenkins-hbase20.apache.org,44603,1698594767651/jenkins-hbase20.apache.org%2C44603%2C1698594767651.1698594769637 2023-10-29 15:52:49,662 DEBUG [RS:0;jenkins-hbase20:44603] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39799,DS-939b4282-ad98-4145-8a96-ac22873b3ca1,DISK]] 2023-10-29 15:52:49,737 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:49,740 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 15:52:49,747 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56946, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 15:52:49,761 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-10-29 15:52:49,762 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-10-29 15:52:49,768 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C44603%2C1698594767651.meta, suffix=.meta, logDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/WALs/jenkins-hbase20.apache.org,44603,1698594767651, archiveDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/oldWALs, maxLogs=32 2023-10-29 15:52:49,811 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39799,DS-939b4282-ad98-4145-8a96-ac22873b3ca1,DISK] 2023-10-29 15:52:49,824 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/WALs/jenkins-hbase20.apache.org,44603,1698594767651/jenkins-hbase20.apache.org%2C44603%2C1698594767651.meta.1698594769776.meta 2023-10-29 15:52:49,826 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39799,DS-939b4282-ad98-4145-8a96-ac22873b3ca1,DISK]] 2023-10-29 15:52:49,827 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:52:49,829 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-10-29 15:52:49,852 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-10-29 15:52:49,858 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-10-29 15:52:49,865 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-10-29 15:52:49,866 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:52:49,866 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-10-29 15:52:49,866 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-10-29 15:52:49,870 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-10-29 15:52:49,872 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/info 2023-10-29 15:52:49,873 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/info 2023-10-29 15:52:49,873 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-10-29 15:52:49,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:49,875 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-10-29 15:52:49,876 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/rep_barrier 2023-10-29 15:52:49,876 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/rep_barrier 2023-10-29 15:52:49,877 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-10-29 15:52:49,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:49,878 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-10-29 15:52:49,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/table 2023-10-29 15:52:49,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/table 2023-10-29 15:52:49,881 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-10-29 15:52:49,884 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:49,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740 2023-10-29 15:52:49,892 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740 2023-10-29 15:52:49,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-10-29 15:52:49,903 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-10-29 15:52:49,905 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67865345, jitterRate=0.011272445321083069}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-10-29 15:52:49,905 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-10-29 15:52:49,916 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1698594769728 2023-10-29 15:52:49,936 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-10-29 15:52:49,936 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,44603,1698594767651, state=OPEN 2023-10-29 15:52:49,937 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-10-29 15:52:49,939 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-10-29 15:52:49,939 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-10-29 15:52:49,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-10-29 15:52:49,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,44603,1698594767651 in 387 msec 2023-10-29 15:52:49,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-10-29 15:52:49,950 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 572 msec 2023-10-29 15:52:49,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 802 msec 2023-10-29 15:52:49,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1698594769956, completionTime=-1 2023-10-29 15:52:49,956 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-10-29 15:52:49,957 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-10-29 15:52:50,022 DEBUG [hconnection-0x7c98951f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:52:50,027 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:52:50,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-10-29 15:52:50,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1698594830049 2023-10-29 15:52:50,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1698594890049 2023-10-29 15:52:50,049 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 91 msec 2023-10-29 15:52:50,077 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46089,1698594766633-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:50,077 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46089,1698594766633-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:50,077 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46089,1698594766633-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:50,079 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:46089, period=300000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:50,079 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-10-29 15:52:50,091 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-10-29 15:52:50,099 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-10-29 15:52:50,100 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-10-29 15:52:50,111 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-10-29 15:52:50,113 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:52:50,116 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:52:50,142 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:50,145 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8 empty. 2023-10-29 15:52:50,145 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:50,146 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-10-29 15:52:50,578 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-10-29 15:52:50,580 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1bd9f715b3bb09014b04e9b305ab6aa8, NAME => 'hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:52:50,997 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:52:50,997 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1bd9f715b3bb09014b04e9b305ab6aa8, disabling compactions & flushes 2023-10-29 15:52:50,997 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:52:50,997 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:52:50,997 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. after waiting 0 ms 2023-10-29 15:52:50,997 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:52:50,997 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:52:50,998 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1bd9f715b3bb09014b04e9b305ab6aa8: 2023-10-29 15:52:51,007 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:52:51,022 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698594771010"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594771010"}]},"ts":"1698594771010"} 2023-10-29 15:52:51,043 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:52:51,045 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:52:51,049 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594771045"}]},"ts":"1698594771045"} 2023-10-29 15:52:51,052 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-10-29 15:52:51,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1bd9f715b3bb09014b04e9b305ab6aa8, ASSIGN}] 2023-10-29 15:52:51,062 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1bd9f715b3bb09014b04e9b305ab6aa8, ASSIGN 2023-10-29 15:52:51,064 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1bd9f715b3bb09014b04e9b305ab6aa8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:52:51,216 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1bd9f715b3bb09014b04e9b305ab6aa8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:51,216 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698594771215"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594771215"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594771215"}]},"ts":"1698594771215"} 2023-10-29 15:52:51,224 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1bd9f715b3bb09014b04e9b305ab6aa8, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:52:51,378 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:51,385 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:52:51,386 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1bd9f715b3bb09014b04e9b305ab6aa8, NAME => 'hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:52:51,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:51,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:52:51,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:51,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:51,390 INFO [StoreOpener-1bd9f715b3bb09014b04e9b305ab6aa8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:51,395 DEBUG [StoreOpener-1bd9f715b3bb09014b04e9b305ab6aa8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8/info 2023-10-29 15:52:51,395 DEBUG [StoreOpener-1bd9f715b3bb09014b04e9b305ab6aa8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8/info 2023-10-29 15:52:51,396 INFO [StoreOpener-1bd9f715b3bb09014b04e9b305ab6aa8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bd9f715b3bb09014b04e9b305ab6aa8 columnFamilyName info 2023-10-29 15:52:51,397 INFO [StoreOpener-1bd9f715b3bb09014b04e9b305ab6aa8-1] regionserver.HStore(310): Store=1bd9f715b3bb09014b04e9b305ab6aa8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:51,399 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:51,400 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:51,407 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:52:51,413 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:52:51,414 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1bd9f715b3bb09014b04e9b305ab6aa8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69196763, jitterRate=0.031112119555473328}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:52:51,414 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1bd9f715b3bb09014b04e9b305ab6aa8: 2023-10-29 15:52:51,417 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8., pid=6, masterSystemTime=1698594771378 2023-10-29 15:52:51,422 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:52:51,422 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:52:51,425 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1bd9f715b3bb09014b04e9b305ab6aa8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:51,426 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1698594771424"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594771424"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594771424"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594771424"}]},"ts":"1698594771424"} 2023-10-29 15:52:51,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-10-29 15:52:51,438 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1bd9f715b3bb09014b04e9b305ab6aa8, server=jenkins-hbase20.apache.org,44603,1698594767651 in 209 msec 2023-10-29 15:52:51,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-10-29 15:52:51,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1bd9f715b3bb09014b04e9b305ab6aa8, ASSIGN in 378 msec 2023-10-29 15:52:51,443 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:52:51,444 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594771444"}]},"ts":"1698594771444"} 2023-10-29 15:52:51,448 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-10-29 15:52:51,452 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:52:51,456 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3510 sec 2023-10-29 15:52:51,514 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-10-29 15:52:51,515 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-10-29 15:52:51,515 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:52:51,554 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-10-29 15:52:51,572 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 15:52:51,577 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-29 15:52:51,582 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2023-10-29 15:52:51,589 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-10-29 15:52:51,605 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 15:52:51,610 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2023-10-29 15:52:51,624 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-10-29 15:52:51,626 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-10-29 15:52:51,626 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.882sec 2023-10-29 15:52:51,628 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-10-29 15:52:51,629 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-10-29 15:52:51,629 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-10-29 15:52:51,630 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46089,1698594766633-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-10-29 15:52:51,631 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,46089,1698594766633-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-10-29 15:52:51,642 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-10-29 15:52:51,725 DEBUG [Listener at localhost/37167] zookeeper.ReadOnlyZKClient(139): Connect 0x5785bd1d to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:52:51,731 DEBUG [Listener at localhost/37167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@47187671, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:52:51,747 DEBUG [hconnection-0x60a3d3c1-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:52:51,760 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:52:51,771 INFO [Listener at localhost/37167] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:52:51,774 DEBUG [Listener at localhost/37167] zookeeper.ReadOnlyZKClient(139): Connect 0x27cfb7ff to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:52:51,781 DEBUG [Listener at localhost/37167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7ed594ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:52:51,782 INFO [Listener at localhost/37167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:52:51,810 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=212, OpenFileDescriptor=478, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=171, AvailableMemoryMB=3627 2023-10-29 15:52:51,823 DEBUG [Listener at localhost/37167] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:52:51,828 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:52:51,841 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 15:52:51,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:51,846 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:52:51,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:52:51,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-10-29 15:52:51,852 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:51,854 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef empty. 2023-10-29 15:52:51,856 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:51,856 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-10-29 15:52:51,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 15:52:51,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 15:52:52,173 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 15:52:52,277 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-29 15:52:52,279 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 502202033c73d0cc1a577d5b2a13beef, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:52:52,295 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:52:52,295 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 502202033c73d0cc1a577d5b2a13beef, disabling compactions & flushes 2023-10-29 15:52:52,295 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:52,295 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:52,295 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. after waiting 0 ms 2023-10-29 15:52:52,295 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:52,295 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:52,295 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:52,300 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:52:52,301 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698594772301"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594772301"}]},"ts":"1698594772301"} 2023-10-29 15:52:52,304 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:52:52,306 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:52:52,306 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594772306"}]},"ts":"1698594772306"} 2023-10-29 15:52:52,308 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-10-29 15:52:52,312 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=502202033c73d0cc1a577d5b2a13beef, ASSIGN}] 2023-10-29 15:52:52,314 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=502202033c73d0cc1a577d5b2a13beef, ASSIGN 2023-10-29 15:52:52,316 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=502202033c73d0cc1a577d5b2a13beef, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:52:52,467 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=502202033c73d0cc1a577d5b2a13beef, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:52,467 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698594772467"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594772467"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594772467"}]},"ts":"1698594772467"} 2023-10-29 15:52:52,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 502202033c73d0cc1a577d5b2a13beef, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:52:52,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 15:52:52,624 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:52,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:52,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 502202033c73d0cc1a577d5b2a13beef, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:52:52,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:52,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:52:52,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:52,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:52,637 INFO [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:52,640 DEBUG [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:52:52,640 DEBUG [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:52:52,644 INFO [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 502202033c73d0cc1a577d5b2a13beef columnFamilyName family1 2023-10-29 15:52:52,648 INFO [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] regionserver.HStore(310): Store=502202033c73d0cc1a577d5b2a13beef/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:52:52,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:52,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:52,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:52:52,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:52:52,667 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 502202033c73d0cc1a577d5b2a13beef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71505193, jitterRate=0.06551040709018707}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:52:52,667 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:52,669 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef., pid=11, masterSystemTime=1698594772624 2023-10-29 15:52:52,673 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:52,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:52,674 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=502202033c73d0cc1a577d5b2a13beef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:52,674 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698594772673"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594772673"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594772673"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594772673"}]},"ts":"1698594772673"} 2023-10-29 15:52:52,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-10-29 15:52:52,681 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 502202033c73d0cc1a577d5b2a13beef, server=jenkins-hbase20.apache.org,44603,1698594767651 in 206 msec 2023-10-29 15:52:52,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-10-29 15:52:52,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=502202033c73d0cc1a577d5b2a13beef, ASSIGN in 370 msec 2023-10-29 15:52:52,686 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:52:52,686 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594772686"}]},"ts":"1698594772686"} 2023-10-29 15:52:52,689 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-10-29 15:52:52,692 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:52:52,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 851 msec 2023-10-29 15:52:52,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-10-29 15:52:52,980 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-10-29 15:52:53,000 DEBUG [hconnection-0x12fe5174-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:52:53,004 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51930, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:52:53,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:53,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:53,148 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:53,148 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:53,148 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:53,148 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:53,149 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:53,149 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:53,150 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:53,150 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:53,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:53,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:53,151 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:53,151 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:53,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:53,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:53,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:53,152 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:53,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:53,154 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:53,154 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:53,154 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:53,155 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:53,155 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:53,155 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:53,155 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:53,156 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 15:52:53,687 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130622f9bc72cc6464c9c792a19a0b8872f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130622f9bc72cc6464c9c792a19a0b8872f 2023-10-29 15:52:54,103 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/76e0f4a9395d4036ab84b90de4beb38e 2023-10-29 15:52:54,119 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/76e0f4a9395d4036ab84b90de4beb38e as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/76e0f4a9395d4036ab84b90de4beb38e 2023-10-29 15:52:54,128 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/76e0f4a9395d4036ab84b90de4beb38e, entries=1000, sequenceid=5, filesize=175.8 K 2023-10-29 15:52:54,132 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 976ms, sequenceid=5, compaction requested=false 2023-10-29 15:52:54,133 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:54,138 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:54,138 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:54,138 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:54,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,264 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:54,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:54,265 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,265 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:54,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:54,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:54,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:54,270 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:54,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5cbfa3e1[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:54,270 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,287 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,287 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:54,287 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:54,287 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,287 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:54,287 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:54,290 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,290 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:54,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:54,290 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:54,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:54,290 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:54,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:54,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:54,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:54,294 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:54,294 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:54,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:54,294 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:54,294 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,294 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:54,296 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,296 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:54,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,296 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:54,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:54,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:54,297 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:54,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,299 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:54,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,306 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,306 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:54,306 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:54,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:54,306 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:54,306 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:54,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:54,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:54,306 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,307 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,307 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,307 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,307 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,307 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:54,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:54,309 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:54,309 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:54,409 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:52:54,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:52:54,431 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:54,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:52:54,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,434 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:54,434 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:54,434 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:54,434 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:54,435 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,435 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,440 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,440 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:54,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:54,440 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:54,440 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:54,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,441 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:54,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,442 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,444 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:52:54,444 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:54,444 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:54,444 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:54,445 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:54,445 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:54,445 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:54,445 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:54,445 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:54,445 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 15:52:54,874 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128e94f30a9aa4f4c499906d7a614b5a728 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e94f30a9aa4f4c499906d7a614b5a728 2023-10-29 15:52:55,303 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/270258b541e64d7386edc065e34ae677 2023-10-29 15:52:55,316 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/270258b541e64d7386edc065e34ae677 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/270258b541e64d7386edc065e34ae677 2023-10-29 15:52:55,327 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/270258b541e64d7386edc065e34ae677, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 15:52:55,329 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 884ms, sequenceid=9, compaction requested=false 2023-10-29 15:52:55,329 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:55,329 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:55,329 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:55,330 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:55,330 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,330 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:55,330 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:55,332 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,332 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:55,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:55,332 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,333 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:55,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:55,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:55,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@976afd4[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:55,334 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:55,334 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,335 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,335 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:55,335 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:55,336 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:55,336 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,336 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:55,339 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:55,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,339 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:55,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:55,339 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:55,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:55,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:55,343 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:55,343 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:55,343 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:55,343 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:55,343 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,343 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:55,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:55,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:55,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:55,349 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:55,350 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,356 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,356 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:55,356 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:55,356 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:55,356 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,356 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:55,357 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,356 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:55,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:55,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:55,357 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,357 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,357 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,357 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:55,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:55,357 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 15:52:55,357 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:55,358 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:55,399 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:52:55,458 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:52:55,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:52:55,461 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-10-29 15:52:55,462 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-10-29 15:52:55,470 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:55,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:52:55,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,473 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:55,473 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:55,473 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:55,473 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:55,474 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,474 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,475 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,475 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:55,475 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:55,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:55,476 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,476 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:55,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,476 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:55,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,477 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,477 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:52:55,477 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,477 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:55,478 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:55,478 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:55,479 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:55,479 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:55,479 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:55,479 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:55,479 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:52:55,908 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512018d006c08629f4bb5a57b5bb63feec2d2 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512018d006c08629f4bb5a57b5bb63feec2d2 2023-10-29 15:52:55,922 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/cce3943a7df04e9cb821d6695e537ffe 2023-10-29 15:52:55,931 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/cce3943a7df04e9cb821d6695e537ffe as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/cce3943a7df04e9cb821d6695e537ffe 2023-10-29 15:52:55,939 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/cce3943a7df04e9cb821d6695e537ffe, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 15:52:55,941 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 461ms, sequenceid=13, compaction requested=true 2023-10-29 15:52:55,941 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:55,941 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:55,941 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:55,941 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:55,941 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,941 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:55,941 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:55,943 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,943 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:55,944 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,944 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:55,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:55,946 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66f3d47e[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:55,946 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:55,946 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,947 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,947 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:55,947 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:55,947 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:55,947 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,947 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:55,949 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:55,949 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,949 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:55,949 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:55,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:55,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:55,952 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:55,953 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:55,953 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:55,953 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,953 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:55,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:55,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:55,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:55,957 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,959 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,965 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,965 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:55,965 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,965 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:55,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:55,965 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:55,965 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,965 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:55,965 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:55,965 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:55,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 15:52:55,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:55,966 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,966 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:55,966 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,966 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:55,966 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:55,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:55,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:56,066 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:52:56,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:52:56,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:56,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:52:56,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,082 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:56,082 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:56,083 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:56,083 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:56,084 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,084 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,087 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:56,087 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:56,087 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,087 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:56,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,088 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:56,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,088 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,088 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:52:56,089 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,089 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:56,089 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:56,089 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:56,090 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:56,090 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:56,090 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:56,090 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:56,090 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:52:56,526 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052538abba6dca4df9b122322a90dae9d0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052538abba6dca4df9b122322a90dae9d0 2023-10-29 15:52:56,539 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/549db298d7cb4540bb64147b1c64e165 2023-10-29 15:52:56,554 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/549db298d7cb4540bb64147b1c64e165 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/549db298d7cb4540bb64147b1c64e165 2023-10-29 15:52:56,567 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/549db298d7cb4540bb64147b1c64e165, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 15:52:56,568 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 478ms, sequenceid=17, compaction requested=true 2023-10-29 15:52:56,568 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:56,568 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:56,569 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:56,569 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:56,569 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,569 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:56,569 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:56,571 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,571 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:56,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:56,572 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,572 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:56,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:56,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47fef8a0[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:56,574 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:56,574 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,576 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:56,576 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:56,576 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:56,576 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,576 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:56,577 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:56,577 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,577 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:56,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:56,577 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:56,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:56,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:56,582 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:56,582 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:56,582 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:56,582 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:56,582 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,582 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:56,589 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,590 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,590 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:56,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:56,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:56,591 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:56,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,592 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:56,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,593 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,600 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:56,600 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:56,601 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:56,601 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 15:52:56,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:56,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:56,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:56,601 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,601 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:56,601 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,602 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,602 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,602 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,602 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,602 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:56,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:56,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:56,602 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:56,702 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:52:56,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:52:56,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:56,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:52:56,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,717 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:56,717 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:56,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:56,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:56,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,719 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,719 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:56,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:56,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:56,720 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:56,720 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:56,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:56,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,721 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,721 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:52:56,721 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:56,721 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:56,721 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:56,722 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:56,722 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:56,722 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:56,722 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:56,722 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:56,722 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:52:56,775 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-29 15:52:56,776 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-10-29 15:52:57,150 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f824b2eb26cc4c97b29b8807efc89c27 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f824b2eb26cc4c97b29b8807efc89c27 2023-10-29 15:52:57,162 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/3f9fa5214dc3455085d45ad16ee96897 2023-10-29 15:52:57,177 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/3f9fa5214dc3455085d45ad16ee96897 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/3f9fa5214dc3455085d45ad16ee96897 2023-10-29 15:52:57,190 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/3f9fa5214dc3455085d45ad16ee96897, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 15:52:57,192 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 470ms, sequenceid=21, compaction requested=true 2023-10-29 15:52:57,192 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:57,192 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:57,192 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:57,194 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:57,194 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,194 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:57,194 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:57,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,197 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:57,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:57,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,198 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:57,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:57,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:57,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@66fffb15[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:57,199 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:57,199 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,200 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,201 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,201 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:57,201 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:57,201 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:57,201 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:57,202 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,202 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:57,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:57,202 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:57,203 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:57,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:57,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:57,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:57,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:57,207 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:57,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:57,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:57,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,207 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:57,209 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,209 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:57,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,209 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:57,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:57,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:57,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:57,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,211 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:57,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:57,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:57,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:57,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:57,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:57,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,217 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:57,218 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:57,218 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:57,319 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:52:57,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:52:57,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:57,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:52:57,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,332 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:57,332 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:57,333 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:57,333 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:57,333 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,333 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,334 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,334 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:57,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:57,335 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,335 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:57,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,335 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:57,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,336 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,336 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:52:57,336 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,336 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:57,337 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:57,337 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:57,338 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:57,338 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:52:57,397 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d30fa32022c94469806b825db78919ee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d30fa32022c94469806b825db78919ee 2023-10-29 15:52:57,814 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/fd1a702fcde54f99b9a7e7360e4e6d0d 2023-10-29 15:52:57,829 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/fd1a702fcde54f99b9a7e7360e4e6d0d as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/fd1a702fcde54f99b9a7e7360e4e6d0d 2023-10-29 15:52:57,840 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/fd1a702fcde54f99b9a7e7360e4e6d0d, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 15:52:57,841 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 503ms, sequenceid=25, compaction requested=true 2023-10-29 15:52:57,842 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:57,842 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:57,842 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:57,842 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:57,842 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,842 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:57,842 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:57,844 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:57,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:57,845 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:57,845 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,845 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:57,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:57,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:57,848 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5a4be011[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:57,848 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:57,848 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,849 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,849 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:57,849 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,849 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:57,849 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:57,849 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:57,851 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:57,851 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:57,851 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:57,851 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:57,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:57,855 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:57,855 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:57,855 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:57,855 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:57,855 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,855 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:57,863 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,863 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:57,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,863 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:57,864 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:57,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:57,866 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:57,871 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:57,871 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:57,871 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:57,871 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:57,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:57,871 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,871 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:57,872 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:57,872 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,872 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 15:52:57,872 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,872 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,872 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,872 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:57,873 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:57,873 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:57,973 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:52:57,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:52:57,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:57,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:52:57,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,989 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:57,989 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:57,990 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:57,990 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:57,991 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,991 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,992 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:57,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:57,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:57,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:57,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,993 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,994 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:52:57,994 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:57,994 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:57,994 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:57,994 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:57,994 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:57,994 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:57,994 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:57,995 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:57,995 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:52:58,019 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601017f871df7120147249fcde658d181b1cc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601017f871df7120147249fcde658d181b1cc 2023-10-29 15:52:58,462 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/e3066474ecef4ad1825e564b9d94e192 2023-10-29 15:52:58,473 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/e3066474ecef4ad1825e564b9d94e192 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/e3066474ecef4ad1825e564b9d94e192 2023-10-29 15:52:58,484 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/e3066474ecef4ad1825e564b9d94e192, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 15:52:58,486 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 491ms, sequenceid=29, compaction requested=true 2023-10-29 15:52:58,487 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:58,487 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:58,487 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:58,488 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:58,488 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,488 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:58,488 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:58,493 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,493 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:58,494 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,494 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:58,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:58,496 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:58,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22639f02[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:58,497 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:58,497 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,506 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,506 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,507 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,507 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:58,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,507 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:58,507 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:58,507 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:58,513 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:58,513 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,513 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:58,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,513 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:58,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:58,517 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:58,517 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:58,517 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:58,517 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:58,517 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,517 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:58,523 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,523 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,523 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:58,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:58,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:58,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:58,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:58,524 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:58,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,526 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:58,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,532 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,532 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:58,533 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,533 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:58,533 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:58,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:58,533 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,533 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,533 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:58,533 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,533 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:58,534 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:58,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:58,533 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:58,535 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:58,535 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:58,635 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:52:58,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:52:58,647 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:58,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:52:58,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,651 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:58,651 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:58,652 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:58,652 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:58,653 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,653 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,654 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:58,654 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:58,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:58,654 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:58,654 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:58,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:58,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:52:58,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:58,656 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:58,656 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:58,657 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:58,657 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:58,657 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:58,657 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:58,657 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:58,657 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:52:59,128 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103b2f84851a9344b98b685b3c016984ea1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b2f84851a9344b98b685b3c016984ea1 2023-10-29 15:52:59,146 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/59c2ce57da834243810a0a04956203fa 2023-10-29 15:52:59,157 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/59c2ce57da834243810a0a04956203fa as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/59c2ce57da834243810a0a04956203fa 2023-10-29 15:52:59,170 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/59c2ce57da834243810a0a04956203fa, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 15:52:59,172 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 515ms, sequenceid=33, compaction requested=true 2023-10-29 15:52:59,172 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:59,172 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:59,172 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:59,173 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:59,173 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,173 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:59,173 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:59,174 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,174 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:59,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:59,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:59,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:59,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:59,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:59,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:59,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@12e85816[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:59,228 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:59,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,230 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:59,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:59,230 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:59,230 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:59,231 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:59,231 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:59,232 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:59,235 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:59,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:59,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:59,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:59,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:59,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:59,250 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:59,250 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:59,250 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:59,250 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:59,251 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,251 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:59,253 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,253 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,253 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:59,253 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:59,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:59,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:59,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:59,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:59,254 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:59,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,257 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:59,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,265 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:59,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:59,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,265 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:59,266 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:59,266 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:59,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:59,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:59,366 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:52:59,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:52:59,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:52:59,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:52:59,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,388 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:59,388 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:59,393 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:52:59,393 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:52:59,393 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,394 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,395 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:59,395 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:59,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:59,395 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,396 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:52:59,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,396 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,396 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,396 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:52:59,396 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:52:59,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,397 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:52:59,397 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:52:59,397 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:52:59,402 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:52:59,402 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:59,403 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:52:59,403 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:52:59,402 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:52:59,459 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509070986edd4ffac4661b37fdb917bda24bc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201509070986edd4ffac4661b37fdb917bda24bc 2023-10-29 15:52:59,876 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/32e6d8c11880432da23651285d37ef86 2023-10-29 15:52:59,894 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/32e6d8c11880432da23651285d37ef86 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/32e6d8c11880432da23651285d37ef86 2023-10-29 15:52:59,911 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/32e6d8c11880432da23651285d37ef86, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 15:52:59,913 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 510ms, sequenceid=37, compaction requested=true 2023-10-29 15:52:59,913 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:52:59,913 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:52:59,914 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:52:59,914 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:52:59,915 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,915 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:52:59,915 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:52:59,916 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:59,916 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:59,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:59,921 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,921 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:52:59,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:52:59,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@bd63e0d[Count = 0] remaining members to acquire global barrier 2023-10-29 15:52:59,921 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:52:59,921 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,931 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,932 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:52:59,932 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:52:59,932 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:52:59,932 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,932 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:52:59,938 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,938 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:52:59,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:59,938 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:59,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:59,938 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:52:59,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:59,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:59,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:59,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:52:59,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:52:59,942 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:52:59,942 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:52:59,942 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:52:59,942 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,942 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:52:59,948 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,949 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,949 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,949 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:59,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:52:59,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:52:59,950 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:59,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:52:59,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:52:59,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,950 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:52:59,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,952 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:52:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:52:59,957 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:52:59,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:52:59,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:52:59,957 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:52:59,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:52:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:52:59,957 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,958 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,958 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:52:59,958 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,958 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,958 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:52:59,958 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:52:59,958 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:52:59,959 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-10-29 15:52:59,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:52:59,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:00,059 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:00,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:00,071 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:00,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:00,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,074 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:53:00,074 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:00,075 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-10-29 15:53:00,075 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-10-29 15:53:00,078 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,078 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,080 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:00,080 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:00,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:00,080 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,080 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:00,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,082 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:00,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,083 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,086 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-10-29 15:53:00,086 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-10-29 15:53:00,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:00,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-10-29 15:53:00,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:00,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:00,088 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:00,088 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. started... 2023-10-29 15:53:00,088 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 502202033c73d0cc1a577d5b2a13beef 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:00,159 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112046ae0e9098784a85a59999105bf15a49 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112046ae0e9098784a85a59999105bf15a49 2023-10-29 15:53:00,176 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/ab2c7bfe586a4be18ea6aa67c5cf1b05 2023-10-29 15:53:00,195 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/ab2c7bfe586a4be18ea6aa67c5cf1b05 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ab2c7bfe586a4be18ea6aa67c5cf1b05 2023-10-29 15:53:00,203 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ab2c7bfe586a4be18ea6aa67c5cf1b05, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 15:53:00,204 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 502202033c73d0cc1a577d5b2a13beef in 116ms, sequenceid=41, compaction requested=true 2023-10-29 15:53:00,204 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:53:00,204 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:00,204 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:00,205 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:00,205 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,205 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-10-29 15:53:00,205 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-10-29 15:53:00,206 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:00,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:00,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:00,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:00,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:00,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:00,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-10-29 15:53:00,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e980c0e[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:00,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-10-29 15:53:00,211 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,223 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-10-29 15:53:00,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-10-29 15:53:00,224 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,224 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:00,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:00,225 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,225 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-10-29 15:53:00,225 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:00,225 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-10-29 15:53:00,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:00,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:00,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:00,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:00,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-10-29 15:53:00,233 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-10-29 15:53:00,233 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:00,233 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:00,233 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,233 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:00,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:00,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:00,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:00,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:00,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:00,241 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:00,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,244 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:00,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,248 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:00,248 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:00,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:00,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:00,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:00,250 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,250 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,250 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-10-29 15:53:00,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:00,251 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:00,251 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:00,250 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:00,251 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,251 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,251 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,250 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:00,351 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:00,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:00,358 DEBUG [Listener at localhost/37167] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 15:53:00,361 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52492, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 15:53:00,363 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:00,378 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:00,379 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:00,381 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595380380 2023-10-29 15:53:00,381 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:00,383 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:53:00,390 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-29 15:53:00,390 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:00,392 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x442f1cd3 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:53:00,399 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2e69829f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:53:00,406 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,030 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c9d76d0404c2480495b859810ac1c97a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103c9d76d0404c2480495b859810ac1c97a 2023-10-29 15:53:01,032 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:01,070 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:53:01,072 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:53:01,090 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:53:01,093 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52506, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:53:01,142 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e323eb95a67b4618a89e27c463d71e11 first=Optional[r3] last=Optional[r6] 2023-10-29 15:53:01,154 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e323eb95a67b4618a89e27c463d71e11}] 2023-10-29 15:53:01,175 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e323eb95a67b4618a89e27c463d71e11 for inclusion in 502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:53:01,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 15:53:01,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:01,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:53:01,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/e323eb95a67b4618a89e27c463d71e11 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uks3v7lv9ni7voubs3dsrqvg3qv1r7qfjkkkpluoctu13gni7ujc6nmnqb2cunh6/family1/e323eb95a67b4618a89e27c463d71e11 2023-10-29 15:53:01,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uks3v7lv9ni7voubs3dsrqvg3qv1r7qfjkkkpluoctu13gni7ujc6nmnqb2cunh6/family1/e323eb95a67b4618a89e27c463d71e11 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/7c16371bc2a142d680ab7c188e6f7532_SeqId_44_ 2023-10-29 15:53:01,191 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uks3v7lv9ni7voubs3dsrqvg3qv1r7qfjkkkpluoctu13gni7ujc6nmnqb2cunh6/family1/e323eb95a67b4618a89e27c463d71e11 into 502202033c73d0cc1a577d5b2a13beef/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/7c16371bc2a142d680ab7c188e6f7532_SeqId_44_ - updating store file list. 2023-10-29 15:53:01,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/7c16371bc2a142d680ab7c188e6f7532_SeqId_44_ into 502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:53:01,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uks3v7lv9ni7voubs3dsrqvg3qv1r7qfjkkkpluoctu13gni7ujc6nmnqb2cunh6/family1/e323eb95a67b4618a89e27c463d71e11 into 502202033c73d0cc1a577d5b2a13beef/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/7c16371bc2a142d680ab7c188e6f7532_SeqId_44_) 2023-10-29 15:53:01,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__uks3v7lv9ni7voubs3dsrqvg3qv1r7qfjkkkpluoctu13gni7ujc6nmnqb2cunh6/family1/e323eb95a67b4618a89e27c463d71e11 2023-10-29 15:53:01,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 15:53:01,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 15:53:01,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): 502202033c73d0cc1a577d5b2a13beef/family1 is initiating minor compaction 2023-10-29 15:53:01,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@52d58450; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:01,216 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 502202033c73d0cc1a577d5b2a13beef/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:01,217 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/270258b541e64d7386edc065e34ae677, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/cce3943a7df04e9cb821d6695e537ffe, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/549db298d7cb4540bb64147b1c64e165, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/3f9fa5214dc3455085d45ad16ee96897, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/fd1a702fcde54f99b9a7e7360e4e6d0d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/e3066474ecef4ad1825e564b9d94e192, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/59c2ce57da834243810a0a04956203fa, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/32e6d8c11880432da23651285d37ef86, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ab2c7bfe586a4be18ea6aa67c5cf1b05, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/7c16371bc2a142d680ab7c188e6f7532_SeqId_44_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp, totalSize=50.2 K 2023-10-29 15:53:01,217 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 270258b541e64d7386edc065e34ae677, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting cce3943a7df04e9cb821d6695e537ffe, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 549db298d7cb4540bb64147b1c64e165, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 3f9fa5214dc3455085d45ad16ee96897, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting fd1a702fcde54f99b9a7e7360e4e6d0d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting e3066474ecef4ad1825e564b9d94e192, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 59c2ce57da834243810a0a04956203fa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 32e6d8c11880432da23651285d37ef86, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting ab2c7bfe586a4be18ea6aa67c5cf1b05, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 15:53:01,218 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 7c16371bc2a142d680ab7c188e6f7532_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 15:53:01,236 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:01,238 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:01,245 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f824b2eb26cc4c97b29b8807efc89c27 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151228f824b2eb26cc4c97b29b8807efc89c27 2023-10-29 15:53:01,247 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d30fa32022c94469806b825db78919ee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151231d30fa32022c94469806b825db78919ee 2023-10-29 15:53:01,258 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601017f871df7120147249fcde658d181b1cc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601017f871df7120147249fcde658d181b1cc 2023-10-29 15:53:01,260 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b2f84851a9344b98b685b3c016984ea1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160103b2f84851a9344b98b685b3c016984ea1 2023-10-29 15:53:01,260 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-10-29 15:53:01,260 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 15:53:01,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,261 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,262 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,335 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 502202033c73d0cc1a577d5b2a13beef#family1#compaction#10 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:01,773 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/355c17612af24f438ba99a2d111253a9 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/355c17612af24f438ba99a2d111253a9 2023-10-29 15:53:01,794 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 502202033c73d0cc1a577d5b2a13beef/family1 of 502202033c73d0cc1a577d5b2a13beef into 355c17612af24f438ba99a2d111253a9(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:53:01,794 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:53:01,796 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1698594781214; duration=0sec 2023-10-29 15:53:01,797 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:01,840 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205eb8179c9aaeb400a85e91a08436f1f58 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205eb8179c9aaeb400a85e91a08436f1f58 2023-10-29 15:53:01,842 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:01,878 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3c1c981eb0c94ee1969455e6123c6ada first=Optional[r00] last=Optional[r2] 2023-10-29 15:53:01,879 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3c1c981eb0c94ee1969455e6123c6ada}] 2023-10-29 15:53:01,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3c1c981eb0c94ee1969455e6123c6ada for inclusion in 502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:53:01,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 15:53:01,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:01,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:53:01,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/270258b541e64d7386edc065e34ae677, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/cce3943a7df04e9cb821d6695e537ffe, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/549db298d7cb4540bb64147b1c64e165, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/3f9fa5214dc3455085d45ad16ee96897, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/fd1a702fcde54f99b9a7e7360e4e6d0d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/e3066474ecef4ad1825e564b9d94e192, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/59c2ce57da834243810a0a04956203fa, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/32e6d8c11880432da23651285d37ef86, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ab2c7bfe586a4be18ea6aa67c5cf1b05, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/7c16371bc2a142d680ab7c188e6f7532_SeqId_44_] to archive 2023-10-29 15:53:01,911 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:01,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3c1c981eb0c94ee1969455e6123c6ada to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1s9neo9utbthoi56gmlap7r38fe3vsp3naa31ln7ki77rpmadd7peu5c64ihveth/family1/3c1c981eb0c94ee1969455e6123c6ada 2023-10-29 15:53:01,917 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/270258b541e64d7386edc065e34ae677 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/270258b541e64d7386edc065e34ae677 2023-10-29 15:53:01,920 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/cce3943a7df04e9cb821d6695e537ffe to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/cce3943a7df04e9cb821d6695e537ffe 2023-10-29 15:53:01,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1s9neo9utbthoi56gmlap7r38fe3vsp3naa31ln7ki77rpmadd7peu5c64ihveth/family1/3c1c981eb0c94ee1969455e6123c6ada as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/a5b1d6c608c3442ba9505b343ace5270_SeqId_47_ 2023-10-29 15:53:01,922 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1s9neo9utbthoi56gmlap7r38fe3vsp3naa31ln7ki77rpmadd7peu5c64ihveth/family1/3c1c981eb0c94ee1969455e6123c6ada into 502202033c73d0cc1a577d5b2a13beef/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/a5b1d6c608c3442ba9505b343ace5270_SeqId_47_ - updating store file list. 2023-10-29 15:53:01,923 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/549db298d7cb4540bb64147b1c64e165 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/549db298d7cb4540bb64147b1c64e165 2023-10-29 15:53:01,926 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/3f9fa5214dc3455085d45ad16ee96897 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/3f9fa5214dc3455085d45ad16ee96897 2023-10-29 15:53:01,930 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/fd1a702fcde54f99b9a7e7360e4e6d0d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/fd1a702fcde54f99b9a7e7360e4e6d0d 2023-10-29 15:53:01,933 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/e3066474ecef4ad1825e564b9d94e192 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/e3066474ecef4ad1825e564b9d94e192 2023-10-29 15:53:01,935 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/59c2ce57da834243810a0a04956203fa to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/59c2ce57da834243810a0a04956203fa 2023-10-29 15:53:01,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/a5b1d6c608c3442ba9505b343ace5270_SeqId_47_ into 502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:53:01,936 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1s9neo9utbthoi56gmlap7r38fe3vsp3naa31ln7ki77rpmadd7peu5c64ihveth/family1/3c1c981eb0c94ee1969455e6123c6ada into 502202033c73d0cc1a577d5b2a13beef/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/a5b1d6c608c3442ba9505b343ace5270_SeqId_47_) 2023-10-29 15:53:01,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__1s9neo9utbthoi56gmlap7r38fe3vsp3naa31ln7ki77rpmadd7peu5c64ihveth/family1/3c1c981eb0c94ee1969455e6123c6ada 2023-10-29 15:53:01,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 15:53:01,939 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/32e6d8c11880432da23651285d37ef86 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/32e6d8c11880432da23651285d37ef86 2023-10-29 15:53:01,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 15:53:01,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): 502202033c73d0cc1a577d5b2a13beef/family1 is initiating minor compaction (all files) 2023-10-29 15:53:01,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3402804c; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:01,941 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 502202033c73d0cc1a577d5b2a13beef/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:01,942 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/76e0f4a9395d4036ab84b90de4beb38e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/355c17612af24f438ba99a2d111253a9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/a5b1d6c608c3442ba9505b343ace5270_SeqId_47_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp, totalSize=358.6 K 2023-10-29 15:53:01,943 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 76e0f4a9395d4036ab84b90de4beb38e, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878851783 2023-10-29 15:53:01,944 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ab2c7bfe586a4be18ea6aa67c5cf1b05 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ab2c7bfe586a4be18ea6aa67c5cf1b05 2023-10-29 15:53:01,945 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 355c17612af24f438ba99a2d111253a9, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621251783 2023-10-29 15:53:01,947 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:01,948 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting a5b1d6c608c3442ba9505b343ace5270_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878851783 2023-10-29 15:53:01,948 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:01,948 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/7c16371bc2a142d680ab7c188e6f7532_SeqId_44_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/7c16371bc2a142d680ab7c188e6f7532_SeqId_44_ 2023-10-29 15:53:01,951 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130622f9bc72cc6464c9c792a19a0b8872f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130622f9bc72cc6464c9c792a19a0b8872f 2023-10-29 15:53:01,956 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512018d006c08629f4bb5a57b5bb63feec2d2 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512018d006c08629f4bb5a57b5bb63feec2d2 2023-10-29 15:53:01,958 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052538abba6dca4df9b122322a90dae9d0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512052538abba6dca4df9b122322a90dae9d0 2023-10-29 15:53:01,958 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-10-29 15:53:01,958 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 15:53:01,960 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:01,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:01,960 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:01,962 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:01,964 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 1.5930 sec 2023-10-29 15:53:02,022 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 502202033c73d0cc1a577d5b2a13beef#family1#compaction#11 average throughput is 4.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:02,129 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/.tmp/family1/e968309fbf644b1dbce7c5c5af2a9c38 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/e968309fbf644b1dbce7c5c5af2a9c38 2023-10-29 15:53:02,147 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 502202033c73d0cc1a577d5b2a13beef/family1 of 502202033c73d0cc1a577d5b2a13beef into e968309fbf644b1dbce7c5c5af2a9c38(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:53:02,147 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:53:02,148 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1698594781940; duration=0sec 2023-10-29 15:53:02,148 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:02,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/76e0f4a9395d4036ab84b90de4beb38e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/355c17612af24f438ba99a2d111253a9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/a5b1d6c608c3442ba9505b343ace5270_SeqId_47_] to archive 2023-10-29 15:53:02,192 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:02,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/76e0f4a9395d4036ab84b90de4beb38e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/76e0f4a9395d4036ab84b90de4beb38e 2023-10-29 15:53:02,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/355c17612af24f438ba99a2d111253a9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/355c17612af24f438ba99a2d111253a9 2023-10-29 15:53:02,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/a5b1d6c608c3442ba9505b343ace5270_SeqId_47_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/a5b1d6c608c3442ba9505b343ace5270_SeqId_47_ 2023-10-29 15:53:02,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 15:53:02,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:02,328 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-29 15:53:02,332 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-10-29 15:53:02,332 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-10-29 15:53:02,338 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-10-29 15:53:02,359 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=502202033c73d0cc1a577d5b2a13beef, REOPEN/MOVE}] 2023-10-29 15:53:02,362 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=502202033c73d0cc1a577d5b2a13beef, REOPEN/MOVE 2023-10-29 15:53:02,363 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=502202033c73d0cc1a577d5b2a13beef, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:02,364 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698594782363"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594782363"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594782363"}]},"ts":"1698594782363"} 2023-10-29 15:53:02,368 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 502202033c73d0cc1a577d5b2a13beef, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:02,527 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:02,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 502202033c73d0cc1a577d5b2a13beef, disabling compactions & flushes 2023-10-29 15:53:02,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:02,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:02,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. after waiting 0 ms 2023-10-29 15:53:02,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:02,551 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 15:53:02,553 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:02,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:53:02,553 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 502202033c73d0cc1a577d5b2a13beef to self. 2023-10-29 15:53:02,558 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,558 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=502202033c73d0cc1a577d5b2a13beef, regionState=CLOSED 2023-10-29 15:53:02,559 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698594782558"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594782558"}]},"ts":"1698594782558"} 2023-10-29 15:53:02,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=15 2023-10-29 15:53:02,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 502202033c73d0cc1a577d5b2a13beef, server=jenkins-hbase20.apache.org,44603,1698594767651 in 194 msec 2023-10-29 15:53:02,568 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=502202033c73d0cc1a577d5b2a13beef, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=true 2023-10-29 15:53:02,719 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=502202033c73d0cc1a577d5b2a13beef, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:02,719 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698594782719"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594782719"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594782719"}]},"ts":"1698594782719"} 2023-10-29 15:53:02,722 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 502202033c73d0cc1a577d5b2a13beef, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:02,876 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:02,881 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:02,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 502202033c73d0cc1a577d5b2a13beef, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:53:02,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:02,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,881 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,883 INFO [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,884 DEBUG [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:53:02,884 DEBUG [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:53:02,885 INFO [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 502202033c73d0cc1a577d5b2a13beef columnFamilyName family1 2023-10-29 15:53:02,892 DEBUG [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/e968309fbf644b1dbce7c5c5af2a9c38 2023-10-29 15:53:02,893 INFO [StoreOpener-502202033c73d0cc1a577d5b2a13beef-1] regionserver.HStore(310): Store=502202033c73d0cc1a577d5b2a13beef/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:02,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,896 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,900 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:53:02,901 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 502202033c73d0cc1a577d5b2a13beef; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66023302, jitterRate=-0.01617613434791565}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:53:02,901 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:53:02,902 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef., pid=17, masterSystemTime=1698594782876 2023-10-29 15:53:02,904 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:02,904 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:53:02,905 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=502202033c73d0cc1a577d5b2a13beef, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:02,905 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1698594782905"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594782905"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594782905"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594782905"}]},"ts":"1698594782905"} 2023-10-29 15:53:02,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=17, resume processing ppid=15 2023-10-29 15:53:02,910 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 502202033c73d0cc1a577d5b2a13beef, server=jenkins-hbase20.apache.org,44603,1698594767651 in 185 msec 2023-10-29 15:53:02,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-10-29 15:53:02,913 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=502202033c73d0cc1a577d5b2a13beef, REOPEN/MOVE in 551 msec 2023-10-29 15:53:02,917 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=14, resume processing ppid=13 2023-10-29 15:53:02,918 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 578 msec 2023-10-29 15:53:02,920 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 633 msec 2023-10-29 15:53:02,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-10-29 15:53:02,932 INFO [Listener at localhost/37167] compactions.TestMobCompactor(278): alter status finished 2023-10-29 15:53:02,934 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-10-29 15:53:02,936 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:02,936 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:02,938 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:02,938 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595382938 2023-10-29 15:53:02,947 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:53:02,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-10-29 15:53:02,948 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:02,949 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x03f0da01 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:53:02,955 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@433415d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:53:02,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:02,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:02,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:02,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:02,955 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:03,402 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112841f2b26e4e0548179e2e2692a5356b34 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112841f2b26e4e0548179e2e2692a5356b34 2023-10-29 15:53:03,404 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:03,416 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:53:03,417 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:53:03,429 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:53:03,431 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43342, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:53:03,448 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/67a7ee9a501a43f7b35efdaf0fab84bd first=Optional[r05] last=Optional[r8] 2023-10-29 15:53:03,449 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=51 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/67a7ee9a501a43f7b35efdaf0fab84bd}] 2023-10-29 15:53:03,456 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/67a7ee9a501a43f7b35efdaf0fab84bd for inclusion in 502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:53:03,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 15:53:03,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:03,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:53:03,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/67a7ee9a501a43f7b35efdaf0fab84bd to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tqn5hq8aea8kfb6ugrmbi2m3oubnv04qsbekii3ndp5b7lrmr1plgsfa98bvb3sv/family1/67a7ee9a501a43f7b35efdaf0fab84bd 2023-10-29 15:53:03,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tqn5hq8aea8kfb6ugrmbi2m3oubnv04qsbekii3ndp5b7lrmr1plgsfa98bvb3sv/family1/67a7ee9a501a43f7b35efdaf0fab84bd as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ff410ba76f03439e9af310f71c1bfe57_SeqId_53_ 2023-10-29 15:53:03,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tqn5hq8aea8kfb6ugrmbi2m3oubnv04qsbekii3ndp5b7lrmr1plgsfa98bvb3sv/family1/67a7ee9a501a43f7b35efdaf0fab84bd into 502202033c73d0cc1a577d5b2a13beef/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ff410ba76f03439e9af310f71c1bfe57_SeqId_53_ - updating store file list. 2023-10-29 15:53:03,474 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ff410ba76f03439e9af310f71c1bfe57_SeqId_53_ into 502202033c73d0cc1a577d5b2a13beef/family1 2023-10-29 15:53:03,475 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tqn5hq8aea8kfb6ugrmbi2m3oubnv04qsbekii3ndp5b7lrmr1plgsfa98bvb3sv/family1/67a7ee9a501a43f7b35efdaf0fab84bd into 502202033c73d0cc1a577d5b2a13beef/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/family1/ff410ba76f03439e9af310f71c1bfe57_SeqId_53_) 2023-10-29 15:53:03,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__tqn5hq8aea8kfb6ugrmbi2m3oubnv04qsbekii3ndp5b7lrmr1plgsfa98bvb3sv/family1/67a7ee9a501a43f7b35efdaf0fab84bd 2023-10-29 15:53:03,478 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:03,480 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:03,482 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112046ae0e9098784a85a59999105bf15a49 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112046ae0e9098784a85a59999105bf15a49 2023-10-29 15:53:03,484 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e94f30a9aa4f4c499906d7a614b5a728 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151128e94f30a9aa4f4c499906d7a614b5a728 2023-10-29 15:53:03,484 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-10-29 15:53:03,484 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 15:53:03,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:03,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:03,485 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-10-29 15:53:03,485 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-10-29 15:53:03,485 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:03,486 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:03,488 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 552 msec 2023-10-29 15:53:03,604 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=250 (was 212) Potentially hanging thread: RS:0;jenkins-hbase20:44603-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43138 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x340fa511-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43092 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x442f1cd3-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43048 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ccae5f4-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x340fa511-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ccae5f4-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:42942 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_990745044_17 at /127.0.0.1:43168 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43116 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x442f1cd3-SendThread(127.0.0.1:62629) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x03f0da01-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43066 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43042 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x340fa511-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43002 [Waiting for operation #16] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43156 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x03f0da01 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1480331107.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:42984 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:42964 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43194 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x5ccae5f4-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x340fa511-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x340fa511-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x03f0da01-SendThread(127.0.0.1:62629) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:43100 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x442f1cd3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1480331107.run(Unknown Source) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=595 (was 478) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=331 (was 316) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 171), AvailableMemoryMB=3504 (was 3627) 2023-10-29 15:53:03,618 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=250, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=171, AvailableMemoryMB=3502 2023-10-29 15:53:03,620 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 15:53:03,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:03,624 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:53:03,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-10-29 15:53:03,625 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:53:03,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 15:53:03,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:03,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd empty. 2023-10-29 15:53:03,631 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:03,632 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-10-29 15:53:03,658 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 15:53:03,659 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 06d9269a82d148eee1a463cd52073bfd, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:53:03,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 15:53:03,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 15:53:04,071 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:04,071 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 06d9269a82d148eee1a463cd52073bfd, disabling compactions & flushes 2023-10-29 15:53:04,071 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:04,071 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:04,071 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. after waiting 0 ms 2023-10-29 15:53:04,071 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:04,071 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:04,071 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:04,074 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:53:04,075 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698594784075"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594784075"}]},"ts":"1698594784075"} 2023-10-29 15:53:04,078 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:53:04,079 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:53:04,079 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594784079"}]},"ts":"1698594784079"} 2023-10-29 15:53:04,081 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-29 15:53:04,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=06d9269a82d148eee1a463cd52073bfd, ASSIGN}] 2023-10-29 15:53:04,087 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=06d9269a82d148eee1a463cd52073bfd, ASSIGN 2023-10-29 15:53:04,088 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=06d9269a82d148eee1a463cd52073bfd, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:53:04,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 15:53:04,239 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=06d9269a82d148eee1a463cd52073bfd, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:04,240 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698594784239"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594784239"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594784239"}]},"ts":"1698594784239"} 2023-10-29 15:53:04,243 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure 06d9269a82d148eee1a463cd52073bfd, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:04,395 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:04,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:04,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 06d9269a82d148eee1a463cd52073bfd, NAME => 'testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:53:04,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy 06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:04,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:04,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:04,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:04,402 INFO [StoreOpener-06d9269a82d148eee1a463cd52073bfd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:04,404 DEBUG [StoreOpener-06d9269a82d148eee1a463cd52073bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1 2023-10-29 15:53:04,404 DEBUG [StoreOpener-06d9269a82d148eee1a463cd52073bfd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1 2023-10-29 15:53:04,405 INFO [StoreOpener-06d9269a82d148eee1a463cd52073bfd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 06d9269a82d148eee1a463cd52073bfd columnFamilyName family1 2023-10-29 15:53:04,407 INFO [StoreOpener-06d9269a82d148eee1a463cd52073bfd-1] regionserver.HStore(310): Store=06d9269a82d148eee1a463cd52073bfd/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:04,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:04,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:04,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:53:04,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:53:04,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 06d9269a82d148eee1a463cd52073bfd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67272236, jitterRate=0.0024344325065612793}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:53:04,417 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:04,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd., pid=21, masterSystemTime=1698594784395 2023-10-29 15:53:04,422 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:04,422 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:04,423 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=06d9269a82d148eee1a463cd52073bfd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:04,423 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698594784423"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594784423"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594784423"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594784423"}]},"ts":"1698594784423"} 2023-10-29 15:53:04,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=21, resume processing ppid=20 2023-10-29 15:53:04,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure 06d9269a82d148eee1a463cd52073bfd, server=jenkins-hbase20.apache.org,44603,1698594767651 in 182 msec 2023-10-29 15:53:04,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=20, resume processing ppid=19 2023-10-29 15:53:04,431 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=06d9269a82d148eee1a463cd52073bfd, ASSIGN in 345 msec 2023-10-29 15:53:04,432 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:53:04,433 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594784432"}]},"ts":"1698594784432"} 2023-10-29 15:53:04,434 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-29 15:53:04,437 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:53:04,439 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 816 msec 2023-10-29 15:53:04,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-10-29 15:53:04,732 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-10-29 15:53:04,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:04,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:04,782 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:04,782 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:04,783 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:04,783 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:04,784 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:04,784 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:04,854 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:04,854 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:04,854 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:04,854 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:04,854 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:04,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:04,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:04,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:04,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:04,855 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:04,855 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:04,856 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:04,856 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:04,856 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:04,856 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:04,856 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:04,856 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:04,857 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:04,857 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 15:53:05,292 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113083f4ba701be14e64af904af67ff4bae1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113083f4ba701be14e64af904af67ff4bae1 2023-10-29 15:53:05,296 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/75f92edb50c34ca3badddaeaa9a39713 2023-10-29 15:53:05,302 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/75f92edb50c34ca3badddaeaa9a39713 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/75f92edb50c34ca3badddaeaa9a39713 2023-10-29 15:53:05,307 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/75f92edb50c34ca3badddaeaa9a39713, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-29 15:53:05,309 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 451ms, sequenceid=5, compaction requested=false 2023-10-29 15:53:05,309 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:05,310 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:05,310 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:05,310 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:05,310 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:05,310 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,310 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:05,310 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:05,311 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,311 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:05,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:05,312 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,312 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:05,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:05,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:05,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:05,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:05,313 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@303d0950[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:05,313 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:05,313 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,314 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,315 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:05,315 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:05,315 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:05,315 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,315 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:05,316 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:05,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:05,316 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:05,316 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:05,316 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:05,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:05,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:05,319 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:05,319 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:05,319 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:05,319 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,319 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:05,329 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,329 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:05,329 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:05,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,330 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:05,331 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:05,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:05,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:05,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:05,339 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:05,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:05,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,339 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:05,340 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,340 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:53:05,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:05,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:05,340 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,341 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:05,341 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,341 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:05,341 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,441 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:05,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:05,447 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:05,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:05,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,449 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:05,449 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:05,449 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:05,449 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:05,450 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,450 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,451 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,451 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:05,451 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:05,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:05,451 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,452 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:05,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,452 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:05,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,452 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,453 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:05,453 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,453 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:05,453 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:05,453 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:05,454 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:05,454 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:05,454 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:05,454 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:05,454 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 15:53:05,872 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112818c600224f8e4f65b8254403fc377a6e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112818c600224f8e4f65b8254403fc377a6e 2023-10-29 15:53:05,878 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/2d655333a38a4912a84e61c9d1fbfbf3 2023-10-29 15:53:05,887 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/2d655333a38a4912a84e61c9d1fbfbf3 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/2d655333a38a4912a84e61c9d1fbfbf3 2023-10-29 15:53:05,893 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/2d655333a38a4912a84e61c9d1fbfbf3, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 15:53:05,894 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 440ms, sequenceid=9, compaction requested=false 2023-10-29 15:53:05,894 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:05,894 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:05,895 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:05,895 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:05,895 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,895 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:05,895 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:05,896 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,896 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:05,896 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,896 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:05,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:05,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:05,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:05,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:05,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@60c5dfa9[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:05,898 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:05,898 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,899 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,899 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:05,899 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:05,899 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:05,899 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,899 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:05,900 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,900 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:05,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:05,900 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:05,900 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:05,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:05,903 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:05,903 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:05,903 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:05,903 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:05,903 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,903 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:05,906 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,906 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,906 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:05,906 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,906 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:05,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,908 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,910 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,910 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:05,910 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,910 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:05,910 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:05,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:05,910 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:05,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:05,910 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:05,910 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:05,911 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,911 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,911 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:05,911 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:05,912 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:05,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:05,912 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:06,012 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:06,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:06,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:06,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:06,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,021 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:06,021 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:06,022 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:06,022 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:06,022 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,023 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,023 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,023 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:06,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:06,024 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,024 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,024 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:06,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,024 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,025 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:06,025 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,025 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:06,025 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:06,025 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:06,025 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:06,025 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:06,025 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:06,025 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:06,026 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:06,441 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201be3b5e23e5424949a77d7834d2cef858 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201be3b5e23e5424949a77d7834d2cef858 2023-10-29 15:53:06,847 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/53b45729fcf04230ba1c42fe40e5b40d 2023-10-29 15:53:06,860 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/53b45729fcf04230ba1c42fe40e5b40d as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/53b45729fcf04230ba1c42fe40e5b40d 2023-10-29 15:53:06,867 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/53b45729fcf04230ba1c42fe40e5b40d, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 15:53:06,868 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 842ms, sequenceid=13, compaction requested=true 2023-10-29 15:53:06,868 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:06,868 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:06,868 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:06,869 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:06,869 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,869 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:06,869 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:06,870 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,870 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:06,870 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,870 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:06,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:06,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:06,872 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5ad9a3ea[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:06,872 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:06,872 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,872 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,872 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:06,873 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:06,873 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:06,873 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,873 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:06,873 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:06,873 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,873 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:06,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:06,873 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:06,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:06,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:06,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:06,877 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:06,878 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:06,878 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:06,878 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,878 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:06,879 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,879 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:06,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:06,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,879 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:06,880 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,880 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:06,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,882 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:06,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,884 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,884 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:06,884 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:06,884 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:06,884 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:53:06,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:06,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:06,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:06,884 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:06,884 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,885 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:06,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:06,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:06,885 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,885 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:06,885 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,885 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:06,885 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:06,986 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:06,987 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:06,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:07,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:07,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,000 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:07,000 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:07,000 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:07,000 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:07,001 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,001 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,002 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:07,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:07,002 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,002 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:07,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:07,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,003 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,003 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:07,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,003 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:07,003 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:07,004 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:07,004 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:07,004 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:07,004 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:07,004 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:07,004 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:07,431 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205a3921adb4dfd46f5ad4286d420918300 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a3921adb4dfd46f5ad4286d420918300 2023-10-29 15:53:07,837 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/04d098599c894bea9503a11e15c7e4d3 2023-10-29 15:53:07,845 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/04d098599c894bea9503a11e15c7e4d3 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/04d098599c894bea9503a11e15c7e4d3 2023-10-29 15:53:07,852 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/04d098599c894bea9503a11e15c7e4d3, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 15:53:07,853 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 849ms, sequenceid=17, compaction requested=true 2023-10-29 15:53:07,853 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:07,853 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:07,853 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:07,854 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:07,854 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,854 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:07,854 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:07,855 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,855 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:07,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:07,855 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,856 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:07,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:07,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:07,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:07,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:07,857 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@146f2cc3[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:07,857 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:07,857 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,859 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,859 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:07,859 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:07,859 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:07,859 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,859 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:07,860 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:07,860 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:07,860 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:07,861 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:07,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:07,863 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:07,863 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:07,863 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:07,863 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:07,863 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,863 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:07,864 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,864 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,864 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:07,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:07,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:07,865 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:07,865 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,866 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:07,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,868 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:07,868 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:07,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:07,868 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:07,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:07,869 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:07,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:07,870 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:07,870 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,870 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,870 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,870 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,870 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,870 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,871 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:07,871 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:07,971 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:07,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:07,984 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:07,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:07,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,991 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:07,991 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:07,991 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:07,991 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:07,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,994 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:07,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:07,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:07,995 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,995 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:07,995 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:07,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:07,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,996 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,996 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:07,997 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:07,997 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:07,997 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:07,997 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:07,998 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:07,998 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:07,998 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:07,998 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:07,998 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:08,023 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228efcf788d690f429bafa1d0d8729dce52 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228efcf788d690f429bafa1d0d8729dce52 2023-10-29 15:53:08,037 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/f6c005e88cf24ef28e57ad34076c66b0 2023-10-29 15:53:08,046 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/f6c005e88cf24ef28e57ad34076c66b0 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/f6c005e88cf24ef28e57ad34076c66b0 2023-10-29 15:53:08,062 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/f6c005e88cf24ef28e57ad34076c66b0, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 15:53:08,063 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 65ms, sequenceid=21, compaction requested=true 2023-10-29 15:53:08,063 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:08,063 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:08,064 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:08,064 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:08,064 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,064 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:08,064 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:08,065 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,066 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,066 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,066 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:08,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c40d097[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:08,069 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:08,069 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,073 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,073 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,073 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:08,073 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:08,073 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:08,073 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:08,074 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:08,074 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:08,074 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,074 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:08,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:08,079 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:08,079 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:08,079 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:08,079 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,079 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:08,083 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:53:08,089 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,089 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,089 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:08,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,094 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:08,094 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,103 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,106 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:08,106 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:08,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:08,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:08,106 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:08,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:08,107 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:08,106 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,107 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,107 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,107 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,107 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,107 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,107 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,107 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:08,107 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:08,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:08,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:08,207 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:08,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:08,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:08,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:08,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,219 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:08,219 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:08,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:08,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:08,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,221 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:08,221 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:08,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:08,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,222 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,222 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:08,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:08,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,223 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,223 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:08,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:08,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:08,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:08,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:08,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:08,224 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:08,225 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:08,225 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:08,255 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231caea147ea9f342b1ae6a510f99b9bc45 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231caea147ea9f342b1ae6a510f99b9bc45 2023-10-29 15:53:08,277 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/41ef28487d52421f9e1fca4c2b725568 2023-10-29 15:53:08,308 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/41ef28487d52421f9e1fca4c2b725568 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/41ef28487d52421f9e1fca4c2b725568 2023-10-29 15:53:08,316 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/41ef28487d52421f9e1fca4c2b725568, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 15:53:08,317 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 92ms, sequenceid=25, compaction requested=true 2023-10-29 15:53:08,317 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:08,317 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:08,318 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:08,318 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:08,318 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,318 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:08,318 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:08,319 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,319 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,320 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,320 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:08,321 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2367621[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:08,321 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:08,321 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,323 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,323 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:08,323 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:08,323 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:08,323 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,324 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:08,325 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,325 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:08,325 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:08,325 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:08,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:08,329 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:08,329 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:08,329 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:08,329 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,329 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:08,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,339 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:08,339 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:08,340 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,342 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:08,348 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,348 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:08,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:08,348 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:08,349 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:08,349 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:08,449 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:08,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:08,458 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:08,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:08,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,462 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:08,462 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:08,463 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:08,463 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:08,463 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,464 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,464 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,464 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:08,464 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:08,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:08,465 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,465 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:08,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,466 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:08,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,466 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,466 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:08,467 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,467 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:08,467 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:08,467 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:08,467 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:08,468 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:08,468 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:08,468 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:08,468 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:08,501 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601016bfd857ac9ba493e91cf56dd4ff63c68 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601016bfd857ac9ba493e91cf56dd4ff63c68 2023-10-29 15:53:08,909 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/c3c7a0c392824204bc811be5add9a248 2023-10-29 15:53:08,920 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/c3c7a0c392824204bc811be5add9a248 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c3c7a0c392824204bc811be5add9a248 2023-10-29 15:53:08,927 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c3c7a0c392824204bc811be5add9a248, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 15:53:08,928 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 460ms, sequenceid=29, compaction requested=true 2023-10-29 15:53:08,928 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:08,928 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:08,928 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:08,928 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:08,928 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,928 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:08,928 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:08,930 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,930 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,930 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,930 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:08,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:08,933 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1567437e[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:08,933 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:08,933 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,934 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,934 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:08,934 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,934 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:08,934 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:08,934 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:08,935 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:08,935 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,935 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:08,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,935 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:08,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:08,939 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:08,939 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:08,940 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:08,940 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:08,940 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,940 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:08,946 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,946 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:08,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,946 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:08,946 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:08,946 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:08,947 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:08,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,948 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:08,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,956 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:08,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:08,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:08,957 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:08,956 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:08,957 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:08,957 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:08,957 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:53:08,957 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:08,958 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,958 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,958 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:08,958 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:08,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:08,958 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:08,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:09,058 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:09,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:09,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:09,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:09,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,071 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:09,071 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:09,072 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:09,072 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:09,073 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,073 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,073 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,073 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:09,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:09,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:09,074 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,074 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,074 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:09,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,074 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,075 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:09,075 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,075 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:09,076 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:09,076 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:09,078 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:09,078 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:09,078 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:09,078 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:09,078 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:09,509 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103feadcbdde005415a824ab2a447c3783b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103feadcbdde005415a824ab2a447c3783b 2023-10-29 15:53:09,521 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/57e8cd527eca42488c2a46420230c54f 2023-10-29 15:53:09,532 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/57e8cd527eca42488c2a46420230c54f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/57e8cd527eca42488c2a46420230c54f 2023-10-29 15:53:09,539 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/57e8cd527eca42488c2a46420230c54f, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 15:53:09,540 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 462ms, sequenceid=33, compaction requested=true 2023-10-29 15:53:09,540 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:09,540 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:09,540 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:09,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:09,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:09,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:09,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,542 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:09,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:09,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:09,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:09,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:09,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:09,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:09,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78036c25[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:09,543 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:09,543 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,545 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,545 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,545 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:09,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:09,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:09,546 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:09,547 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:09,547 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,547 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:09,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,547 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:09,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:09,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:09,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:09,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:09,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:09,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:09,550 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:09,550 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:09,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:09,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:09,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,550 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:09,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:09,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:09,552 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,552 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,553 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,555 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,555 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:09,556 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:09,556 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,556 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,556 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,556 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,556 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:09,556 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:09,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:09,556 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,556 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:09,557 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:09,557 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:09,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:09,557 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:09,557 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:09,657 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:09,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:09,666 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:09,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:09,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,668 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:09,668 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:09,669 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:09,669 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:09,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,673 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:09,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:09,682 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:09,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:09,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:09,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,683 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:09,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,684 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,685 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:09,685 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:09,685 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:09,685 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:09,685 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:09,685 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:09,685 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:09,685 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:09,686 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:09,686 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:10,105 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907f9b53acb41f14108b1b86e0bd0b61c3b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907f9b53acb41f14108b1b86e0bd0b61c3b 2023-10-29 15:53:10,512 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/6b9c2273f5204ce69b98f572c906befc 2023-10-29 15:53:10,519 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/6b9c2273f5204ce69b98f572c906befc as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/6b9c2273f5204ce69b98f572c906befc 2023-10-29 15:53:10,525 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/6b9c2273f5204ce69b98f572c906befc, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 15:53:10,529 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 843ms, sequenceid=37, compaction requested=true 2023-10-29 15:53:10,529 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:10,529 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:10,529 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:10,529 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:10,529 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,530 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:10,530 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:10,531 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,531 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:10,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:10,531 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,531 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:10,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:10,533 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@328ddfda[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:10,533 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:10,533 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,534 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,534 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:10,534 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:10,534 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:10,534 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,534 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:10,535 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:10,535 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,535 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:10,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:10,535 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:10,538 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:10,538 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:10,538 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:10,538 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:10,538 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,538 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:10,539 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,539 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:10,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,539 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:10,539 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:10,539 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,540 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,542 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,542 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,542 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:10,542 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:10,542 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:10,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:10,542 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:10,542 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:53:10,542 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:10,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:10,542 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,543 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,543 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,543 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,543 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:10,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:10,543 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:10,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:10,643 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:10,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:10,650 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:10,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:10,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,652 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:10,652 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:10,653 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:53:10,653 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:10,653 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,653 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,654 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,654 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:10,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:10,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:10,654 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:10,654 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:10,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,655 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:10,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,655 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,655 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:53:10,655 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:10,655 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:53:10,655 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:10,657 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:53:10,657 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:10,657 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:10,657 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:10,657 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. started... 2023-10-29 15:53:10,658 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 06d9269a82d148eee1a463cd52073bfd 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:11,078 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120a0af96fa542a4c1088d1cd7fc9b96074 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a0af96fa542a4c1088d1cd7fc9b96074 2023-10-29 15:53:11,488 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/e59d8cf9e9444974a4cdac02b19a0f5f 2023-10-29 15:53:11,501 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/e59d8cf9e9444974a4cdac02b19a0f5f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/e59d8cf9e9444974a4cdac02b19a0f5f 2023-10-29 15:53:11,508 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/e59d8cf9e9444974a4cdac02b19a0f5f, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 15:53:11,509 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 06d9269a82d148eee1a463cd52073bfd in 851ms, sequenceid=41, compaction requested=true 2023-10-29 15:53:11,510 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:11,510 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:11,510 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:11,510 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:11,510 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,510 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:53:11,510 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:53:11,511 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,511 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:11,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:11,512 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,512 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:11,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:53:11,513 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bb30d4[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:11,513 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:11,513 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,514 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,514 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:11,514 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:53:11,514 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:11,514 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,514 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:11,515 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:53:11,515 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,515 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:11,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:11,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:11,515 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:53:11,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:11,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:11,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:11,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:11,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:11,518 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:53:11,518 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:11,518 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:11,518 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,518 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:11,519 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,519 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,519 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:11,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:11,519 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:11,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:11,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:11,520 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:11,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:11,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,520 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:11,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,522 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,522 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:11,522 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-10-29 15:53:11,522 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:53:11,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:11,522 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,522 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:11,522 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:11,522 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:11,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:11,522 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:11,524 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:11,524 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:11,524 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,524 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:11,524 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,524 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:11,624 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:11,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:11,629 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-10-29 15:53:11,634 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:11,635 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:11,636 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:11,636 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595391636 2023-10-29 15:53:11,638 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:53:11,639 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-29 15:53:11,639 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:53:11,640 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x65cf5318 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:53:11,646 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63650f6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:53:11,646 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:53:12,491 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103f9cb83eaf3f7427fa66e7bf81e51c978 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103f9cb83eaf3f7427fa66e7bf81e51c978 2023-10-29 15:53:12,492 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:53:12,504 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:53:12,505 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38032, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:53:12,512 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:53:12,513 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:53:12,524 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/396d0c2c9cd942699929cabcebb47727 first=Optional[r5] last=Optional[r6] 2023-10-29 15:53:12,524 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/396d0c2c9cd942699929cabcebb47727}] 2023-10-29 15:53:12,529 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/396d0c2c9cd942699929cabcebb47727 for inclusion in 06d9269a82d148eee1a463cd52073bfd/family1 2023-10-29 15:53:12,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-29 15:53:12,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:12,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:12,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/396d0c2c9cd942699929cabcebb47727 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8fp1suus1hikj46d5hnqk470mjee2sbujdeo92vokenme6c79it592cb8q57igjj/family1/396d0c2c9cd942699929cabcebb47727 2023-10-29 15:53:12,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8fp1suus1hikj46d5hnqk470mjee2sbujdeo92vokenme6c79it592cb8q57igjj/family1/396d0c2c9cd942699929cabcebb47727 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_ 2023-10-29 15:53:12,538 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8fp1suus1hikj46d5hnqk470mjee2sbujdeo92vokenme6c79it592cb8q57igjj/family1/396d0c2c9cd942699929cabcebb47727 into 06d9269a82d148eee1a463cd52073bfd/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_ - updating store file list. 2023-10-29 15:53:12,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_ into 06d9269a82d148eee1a463cd52073bfd/family1 2023-10-29 15:53:12,543 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8fp1suus1hikj46d5hnqk470mjee2sbujdeo92vokenme6c79it592cb8q57igjj/family1/396d0c2c9cd942699929cabcebb47727 into 06d9269a82d148eee1a463cd52073bfd/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_) 2023-10-29 15:53:12,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__8fp1suus1hikj46d5hnqk470mjee2sbujdeo92vokenme6c79it592cb8q57igjj/family1/396d0c2c9cd942699929cabcebb47727 2023-10-29 15:53:12,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 15:53:12,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 15:53:12,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): 06d9269a82d148eee1a463cd52073bfd/family1 is initiating minor compaction 2023-10-29 15:53:12,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@626128d3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:12,550 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 06d9269a82d148eee1a463cd52073bfd/family1 in testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:12,551 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/2d655333a38a4912a84e61c9d1fbfbf3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/53b45729fcf04230ba1c42fe40e5b40d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/04d098599c894bea9503a11e15c7e4d3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/f6c005e88cf24ef28e57ad34076c66b0, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/41ef28487d52421f9e1fca4c2b725568, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c3c7a0c392824204bc811be5add9a248, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/57e8cd527eca42488c2a46420230c54f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/6b9c2273f5204ce69b98f572c906befc, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/e59d8cf9e9444974a4cdac02b19a0f5f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp, totalSize=49.7 K 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 2d655333a38a4912a84e61c9d1fbfbf3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 53b45729fcf04230ba1c42fe40e5b40d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 04d098599c894bea9503a11e15c7e4d3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting f6c005e88cf24ef28e57ad34076c66b0, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 41ef28487d52421f9e1fca4c2b725568, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting c3c7a0c392824204bc811be5add9a248, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 57e8cd527eca42488c2a46420230c54f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 6b9c2273f5204ce69b98f572c906befc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting e59d8cf9e9444974a4cdac02b19a0f5f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 15:53:12,551 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 15:53:12,553 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:53:12,553 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:12,555 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601016bfd857ac9ba493e91cf56dd4ff63c68 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601016bfd857ac9ba493e91cf56dd4ff63c68 2023-10-29 15:53:12,556 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103feadcbdde005415a824ab2a447c3783b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103feadcbdde005415a824ab2a447c3783b 2023-10-29 15:53:12,556 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-29 15:53:12,556 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-29 15:53:12,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:53:12,557 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:53:12,590 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 06d9269a82d148eee1a463cd52073bfd#family1#compaction#22 average throughput is 0.27 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:13,416 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/92c9025a601942f3bf6c24142c4e6fbd as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/92c9025a601942f3bf6c24142c4e6fbd 2023-10-29 15:53:13,422 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313aa28ea492654f42bb41602192bb3271 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512313aa28ea492654f42bb41602192bb3271 2023-10-29 15:53:13,424 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:53:13,430 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 06d9269a82d148eee1a463cd52073bfd/family1 of 06d9269a82d148eee1a463cd52073bfd into 92c9025a601942f3bf6c24142c4e6fbd(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:53:13,431 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:13,431 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698594792550; duration=0sec 2023-10-29 15:53:13,431 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:13,458 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6c11704b2ca94ba1beae91c21075543a first=Optional[r1] last=Optional[r4] 2023-10-29 15:53:13,459 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6c11704b2ca94ba1beae91c21075543a}] 2023-10-29 15:53:13,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6c11704b2ca94ba1beae91c21075543a for inclusion in 06d9269a82d148eee1a463cd52073bfd/family1 2023-10-29 15:53:13,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-29 15:53:13,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:13,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:13,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/6c11704b2ca94ba1beae91c21075543a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__96gl4ln58mtd388vcbm99e9vudgqp8e7vf1s8a40ag841k5dvl5gd16onk6cu90b/family1/6c11704b2ca94ba1beae91c21075543a 2023-10-29 15:53:13,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__96gl4ln58mtd388vcbm99e9vudgqp8e7vf1s8a40ag841k5dvl5gd16onk6cu90b/family1/6c11704b2ca94ba1beae91c21075543a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/5aa143328d3441c2808ae2dfeb822bac_SeqId_47_ 2023-10-29 15:53:13,472 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__96gl4ln58mtd388vcbm99e9vudgqp8e7vf1s8a40ag841k5dvl5gd16onk6cu90b/family1/6c11704b2ca94ba1beae91c21075543a into 06d9269a82d148eee1a463cd52073bfd/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/5aa143328d3441c2808ae2dfeb822bac_SeqId_47_ - updating store file list. 2023-10-29 15:53:13,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/5aa143328d3441c2808ae2dfeb822bac_SeqId_47_ into 06d9269a82d148eee1a463cd52073bfd/family1 2023-10-29 15:53:13,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__96gl4ln58mtd388vcbm99e9vudgqp8e7vf1s8a40ag841k5dvl5gd16onk6cu90b/family1/6c11704b2ca94ba1beae91c21075543a into 06d9269a82d148eee1a463cd52073bfd/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/5aa143328d3441c2808ae2dfeb822bac_SeqId_47_) 2023-10-29 15:53:13,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__96gl4ln58mtd388vcbm99e9vudgqp8e7vf1s8a40ag841k5dvl5gd16onk6cu90b/family1/6c11704b2ca94ba1beae91c21075543a 2023-10-29 15:53:13,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 15:53:13,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 15:53:13,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): 06d9269a82d148eee1a463cd52073bfd/family1 is initiating minor compaction (all files) 2023-10-29 15:53:13,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7ccbe4bb; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:13,480 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 06d9269a82d148eee1a463cd52073bfd/family1 in testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:53:13,481 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/75f92edb50c34ca3badddaeaa9a39713, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/92c9025a601942f3bf6c24142c4e6fbd, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/5aa143328d3441c2808ae2dfeb822bac_SeqId_47_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp, totalSize=178.1 K 2023-10-29 15:53:13,485 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 75f92edb50c34ca3badddaeaa9a39713, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878851783 2023-10-29 15:53:13,490 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 92c9025a601942f3bf6c24142c4e6fbd, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621251783 2023-10-29 15:53:13,494 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 5aa143328d3441c2808ae2dfeb822bac_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965251783 2023-10-29 15:53:13,495 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/2d655333a38a4912a84e61c9d1fbfbf3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/53b45729fcf04230ba1c42fe40e5b40d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/04d098599c894bea9503a11e15c7e4d3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/f6c005e88cf24ef28e57ad34076c66b0, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/41ef28487d52421f9e1fca4c2b725568, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c3c7a0c392824204bc811be5add9a248, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/57e8cd527eca42488c2a46420230c54f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/6b9c2273f5204ce69b98f572c906befc, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/e59d8cf9e9444974a4cdac02b19a0f5f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_] to archive 2023-10-29 15:53:13,496 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:53:13,496 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:13,497 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:13,500 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201be3b5e23e5424949a77d7834d2cef858 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151201be3b5e23e5424949a77d7834d2cef858 2023-10-29 15:53:13,503 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/2d655333a38a4912a84e61c9d1fbfbf3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/2d655333a38a4912a84e61c9d1fbfbf3 2023-10-29 15:53:13,506 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a3921adb4dfd46f5ad4286d420918300 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151205a3921adb4dfd46f5ad4286d420918300 2023-10-29 15:53:13,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/53b45729fcf04230ba1c42fe40e5b40d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/53b45729fcf04230ba1c42fe40e5b40d 2023-10-29 15:53:13,508 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228efcf788d690f429bafa1d0d8729dce52 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228efcf788d690f429bafa1d0d8729dce52 2023-10-29 15:53:13,511 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231caea147ea9f342b1ae6a510f99b9bc45 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231caea147ea9f342b1ae6a510f99b9bc45 2023-10-29 15:53:13,511 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/04d098599c894bea9503a11e15c7e4d3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/04d098599c894bea9503a11e15c7e4d3 2023-10-29 15:53:13,511 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-29 15:53:13,511 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-29 15:53:13,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:53:13,512 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:53:13,514 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/f6c005e88cf24ef28e57ad34076c66b0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/f6c005e88cf24ef28e57ad34076c66b0 2023-10-29 15:53:13,516 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/41ef28487d52421f9e1fca4c2b725568 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/41ef28487d52421f9e1fca4c2b725568 2023-10-29 15:53:13,520 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c3c7a0c392824204bc811be5add9a248 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c3c7a0c392824204bc811be5add9a248 2023-10-29 15:53:13,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/57e8cd527eca42488c2a46420230c54f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/57e8cd527eca42488c2a46420230c54f 2023-10-29 15:53:13,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/6b9c2273f5204ce69b98f572c906befc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/6b9c2273f5204ce69b98f572c906befc 2023-10-29 15:53:13,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/e59d8cf9e9444974a4cdac02b19a0f5f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/e59d8cf9e9444974a4cdac02b19a0f5f 2023-10-29 15:53:13,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/59ec71e9f17e4d23bd310b67ba1b1c87_SeqId_44_ 2023-10-29 15:53:13,545 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 06d9269a82d148eee1a463cd52073bfd#family1#compaction#23 average throughput is 6.77 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:14,019 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130ef1ae7754a5043d1a3fc2adaf44362ef to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130ef1ae7754a5043d1a3fc2adaf44362ef 2023-10-29 15:53:14,021 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:53:14,045 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9616e811b2a84a279ac68548c9857435 first=Optional[r00] last=Optional[r8] 2023-10-29 15:53:14,046 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9616e811b2a84a279ac68548c9857435}] 2023-10-29 15:53:14,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9616e811b2a84a279ac68548c9857435 for inclusion in 06d9269a82d148eee1a463cd52073bfd/family1 2023-10-29 15:53:14,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-29 15:53:14,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:14,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:14,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/9616e811b2a84a279ac68548c9857435 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j9ke4n95g8731jb5r7pk8osk35n98ndgoqe5glphep77711c75p006ru532sgllb/family1/9616e811b2a84a279ac68548c9857435 2023-10-29 15:53:14,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j9ke4n95g8731jb5r7pk8osk35n98ndgoqe5glphep77711c75p006ru532sgllb/family1/9616e811b2a84a279ac68548c9857435 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c5ed1e6adaaf4fdda6866fb40d659a51_SeqId_49_ 2023-10-29 15:53:14,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j9ke4n95g8731jb5r7pk8osk35n98ndgoqe5glphep77711c75p006ru532sgllb/family1/9616e811b2a84a279ac68548c9857435 into 06d9269a82d148eee1a463cd52073bfd/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c5ed1e6adaaf4fdda6866fb40d659a51_SeqId_49_ - updating store file list. 2023-10-29 15:53:14,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c5ed1e6adaaf4fdda6866fb40d659a51_SeqId_49_ into 06d9269a82d148eee1a463cd52073bfd/family1 2023-10-29 15:53:14,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j9ke4n95g8731jb5r7pk8osk35n98ndgoqe5glphep77711c75p006ru532sgllb/family1/9616e811b2a84a279ac68548c9857435 into 06d9269a82d148eee1a463cd52073bfd/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/c5ed1e6adaaf4fdda6866fb40d659a51_SeqId_49_) 2023-10-29 15:53:14,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithMonthlyPolicy__j9ke4n95g8731jb5r7pk8osk35n98ndgoqe5glphep77711c75p006ru532sgllb/family1/9616e811b2a84a279ac68548c9857435 2023-10-29 15:53:14,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:53:14,063 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:14,065 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a0af96fa542a4c1088d1cd7fc9b96074 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151120a0af96fa542a4c1088d1cd7fc9b96074 2023-10-29 15:53:14,066 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112818c600224f8e4f65b8254403fc377a6e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112818c600224f8e4f65b8254403fc377a6e 2023-10-29 15:53:14,067 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113083f4ba701be14e64af904af67ff4bae1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015113083f4ba701be14e64af904af67ff4bae1 2023-10-29 15:53:14,067 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-29 15:53:14,067 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 15:53:14,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:53:14,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:53:14,068 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:53:14,068 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:53:14,068 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:14,069 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:14,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 2.4370 sec 2023-10-29 15:53:14,199 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=255 (was 250) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:40698 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:52114 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xdd8e081-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:52106 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/cluster_89962ca0-ab74-9933-047b-7d7164e2e3b8/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xdd8e081-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x65cf5318 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$46/1480331107.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xdd8e081-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:52182 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:52082 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:40696 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xdd8e081-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x65cf5318-SendThread(127.0.0.1:62629) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:345) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1223) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:40636 [Waiting for operation #14] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/cluster_89962ca0-ab74-9933-047b-7d7164e2e3b8/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_990745044_17 at /127.0.0.1:52188 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:40610 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/db7ca616caef408390e7e30cc61a1ea1 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:52018 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:40710 [Waiting for operation #21] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:52134 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xdd8e081-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:52064 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1574802276_17 at /127.0.0.1:40668 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xdd8e081-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xdd8e081-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:62629@0x65cf5318-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:506) - Thread LEAK? -, OpenFileDescriptor=607 (was 595) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=333 (was 331) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 171), AvailableMemoryMB=3298 (was 3502) 2023-10-29 15:53:14,210 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=255, OpenFileDescriptor=607, MaxFileDescriptor=60000, SystemLoadAverage=333, ProcessCount=168, AvailableMemoryMB=3298 2023-10-29 15:53:14,212 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 15:53:14,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:14,215 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:53:14,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-10-29 15:53:14,216 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:53:14,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 15:53:14,218 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:14,218 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8 empty. 2023-10-29 15:53:14,219 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:14,219 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-10-29 15:53:14,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 15:53:14,365 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/.tmp/family1/db7ca616caef408390e7e30cc61a1ea1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/db7ca616caef408390e7e30cc61a1ea1 2023-10-29 15:53:14,371 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 06d9269a82d148eee1a463cd52073bfd/family1 of 06d9269a82d148eee1a463cd52073bfd into db7ca616caef408390e7e30cc61a1ea1(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:53:14,371 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:53:14,372 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698594793479; duration=0sec 2023-10-29 15:53:14,372 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:14,390 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/75f92edb50c34ca3badddaeaa9a39713, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/92c9025a601942f3bf6c24142c4e6fbd, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/5aa143328d3441c2808ae2dfeb822bac_SeqId_47_] to archive 2023-10-29 15:53:14,391 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:14,394 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/75f92edb50c34ca3badddaeaa9a39713 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/75f92edb50c34ca3badddaeaa9a39713 2023-10-29 15:53:14,396 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/92c9025a601942f3bf6c24142c4e6fbd to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/92c9025a601942f3bf6c24142c4e6fbd 2023-10-29 15:53:14,398 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/5aa143328d3441c2808ae2dfeb822bac_SeqId_47_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/family1/5aa143328d3441c2808ae2dfeb822bac_SeqId_47_ 2023-10-29 15:53:14,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 15:53:14,630 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 15:53:14,632 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 82f7ba83074cecf15632fcdb3ca381e8, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:53:14,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 15:53:15,044 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:15,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 82f7ba83074cecf15632fcdb3ca381e8, disabling compactions & flushes 2023-10-29 15:53:15,045 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:15,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:15,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. after waiting 0 ms 2023-10-29 15:53:15,045 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:15,045 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:15,046 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:15,050 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:53:15,052 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698594795052"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594795052"}]},"ts":"1698594795052"} 2023-10-29 15:53:15,054 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:53:15,056 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:53:15,056 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594795056"}]},"ts":"1698594795056"} 2023-10-29 15:53:15,058 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-29 15:53:15,062 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=82f7ba83074cecf15632fcdb3ca381e8, ASSIGN}] 2023-10-29 15:53:15,064 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=82f7ba83074cecf15632fcdb3ca381e8, ASSIGN 2023-10-29 15:53:15,065 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=82f7ba83074cecf15632fcdb3ca381e8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:53:15,217 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=82f7ba83074cecf15632fcdb3ca381e8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:15,217 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698594795217"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594795217"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594795217"}]},"ts":"1698594795217"} 2023-10-29 15:53:15,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 82f7ba83074cecf15632fcdb3ca381e8, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:15,323 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 15:53:15,375 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:15,380 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82f7ba83074cecf15632fcdb3ca381e8, NAME => 'testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:53:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:15,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:15,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:15,382 INFO [StoreOpener-82f7ba83074cecf15632fcdb3ca381e8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:15,384 DEBUG [StoreOpener-82f7ba83074cecf15632fcdb3ca381e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1 2023-10-29 15:53:15,384 DEBUG [StoreOpener-82f7ba83074cecf15632fcdb3ca381e8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1 2023-10-29 15:53:15,385 INFO [StoreOpener-82f7ba83074cecf15632fcdb3ca381e8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82f7ba83074cecf15632fcdb3ca381e8 columnFamilyName family1 2023-10-29 15:53:15,387 INFO [StoreOpener-82f7ba83074cecf15632fcdb3ca381e8-1] regionserver.HStore(310): Store=82f7ba83074cecf15632fcdb3ca381e8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:15,388 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:15,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:15,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:53:15,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:53:15,397 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 82f7ba83074cecf15632fcdb3ca381e8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65141504, jitterRate=-0.029315948486328125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:53:15,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:15,399 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8., pid=25, masterSystemTime=1698594795375 2023-10-29 15:53:15,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:15,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:15,402 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=82f7ba83074cecf15632fcdb3ca381e8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:15,402 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698594795402"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594795402"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594795402"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594795402"}]},"ts":"1698594795402"} 2023-10-29 15:53:15,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=24 2023-10-29 15:53:15,407 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 82f7ba83074cecf15632fcdb3ca381e8, server=jenkins-hbase20.apache.org,44603,1698594767651 in 184 msec 2023-10-29 15:53:15,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=23 2023-10-29 15:53:15,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=82f7ba83074cecf15632fcdb3ca381e8, ASSIGN in 345 msec 2023-10-29 15:53:15,410 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:53:15,410 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594795410"}]},"ts":"1698594795410"} 2023-10-29 15:53:15,411 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-29 15:53:15,414 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:53:15,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 1.2020 sec 2023-10-29 15:53:16,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-10-29 15:53:16,326 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-10-29 15:53:16,357 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:16,358 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:16,358 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:16,358 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:16,358 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:16,358 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:16,359 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:16,359 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:16,360 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:16,360 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:16,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:16,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:16,360 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:16,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:16,360 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:16,361 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:16,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:16,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:16,361 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:16,361 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:16,361 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:16,361 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:16,362 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:16,362 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:16,362 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:16,362 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:16,362 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:16,362 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 15:53:16,788 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113086fa4476f3f24ed895ffff9a7c8f374b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015113086fa4476f3f24ed895ffff9a7c8f374b 2023-10-29 15:53:17,194 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/90b2c0e9235d4b1fa63cfccb799157b3 2023-10-29 15:53:17,203 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/90b2c0e9235d4b1fa63cfccb799157b3 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/90b2c0e9235d4b1fa63cfccb799157b3 2023-10-29 15:53:17,210 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/90b2c0e9235d4b1fa63cfccb799157b3, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-29 15:53:17,211 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 849ms, sequenceid=5, compaction requested=false 2023-10-29 15:53:17,211 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:17,211 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:17,211 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:17,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:17,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:17,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:17,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:17,212 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,212 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:17,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:17,213 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,213 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:17,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:17,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:17,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:17,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:17,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2c68ff6e[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:17,214 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:17,214 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,215 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,215 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,215 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:17,215 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:17,215 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:17,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:17,216 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,216 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:17,216 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:17,216 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:17,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:17,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:17,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:17,218 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:17,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:17,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:17,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,218 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:17,219 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,219 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:17,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,219 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:17,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,221 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,223 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,223 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,223 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:17,223 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:17,223 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:17,223 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:17,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:17,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:17,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:17,223 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:17,223 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,224 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:17,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:17,224 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:17,224 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:17,224 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,224 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,224 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,324 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:17,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:17,336 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:17,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:17,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,339 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:17,339 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:17,339 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:17,339 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:17,340 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,340 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,341 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:17,341 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:17,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:17,342 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:17,342 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:17,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:17,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,344 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,344 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:17,344 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:17,344 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:17,344 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:17,344 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:17,345 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:17,345 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:17,345 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:17,345 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:17,345 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 15:53:17,774 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128254b51d4d47e46e08b48111708132422 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128254b51d4d47e46e08b48111708132422 2023-10-29 15:53:18,184 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/319b51c149624e8aae3814fadd2d9a44 2023-10-29 15:53:18,197 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/319b51c149624e8aae3814fadd2d9a44 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/319b51c149624e8aae3814fadd2d9a44 2023-10-29 15:53:18,205 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/319b51c149624e8aae3814fadd2d9a44, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 15:53:18,206 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 861ms, sequenceid=9, compaction requested=false 2023-10-29 15:53:18,206 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:18,206 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:18,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:18,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:18,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:18,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:18,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,208 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:18,209 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,209 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:18,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:18,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4fe9cc82[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:18,211 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:18,211 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,212 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,213 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:18,213 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:18,213 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:18,213 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,213 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:18,214 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,214 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:18,214 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:18,214 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:18,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:18,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:18,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:18,218 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:18,218 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:18,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:18,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:18,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,218 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:18,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:18,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:18,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,230 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:18,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:18,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:18,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,233 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:18,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,237 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,237 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:18,237 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,237 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:18,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:18,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:18,237 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:18,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:18,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:18,237 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,237 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:18,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,238 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:18,238 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:18,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:18,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:18,338 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:18,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:18,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:18,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:18,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,347 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:18,347 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:18,347 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:18,347 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:18,348 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,348 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,349 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,349 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:18,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:18,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:18,350 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:18,350 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:18,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,350 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:18,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,351 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,351 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:18,351 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:18,351 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:18,351 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:18,351 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:18,352 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:18,352 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:18,352 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:18,352 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:18,352 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:18,781 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120168a88cef4afd485ebe6b4dba60e91c2e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120168a88cef4afd485ebe6b4dba60e91c2e 2023-10-29 15:53:19,191 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/7efae1ce69624b5db36f2e8ebee7b87e 2023-10-29 15:53:19,208 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/7efae1ce69624b5db36f2e8ebee7b87e as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/7efae1ce69624b5db36f2e8ebee7b87e 2023-10-29 15:53:19,216 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/7efae1ce69624b5db36f2e8ebee7b87e, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 15:53:19,217 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 865ms, sequenceid=13, compaction requested=true 2023-10-29 15:53:19,217 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:19,217 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:19,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:19,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:19,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:19,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:19,219 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,219 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:19,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:19,219 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,219 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:19,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:19,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:19,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:19,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1346b9aa[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:19,221 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:19,222 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,223 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:19,223 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:19,223 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:19,223 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,223 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:19,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:19,224 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:19,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:19,224 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:19,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:19,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:19,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:19,228 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:19,228 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:19,228 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:19,228 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,229 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:19,230 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:19,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:19,230 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,230 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:19,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:19,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:19,231 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:19,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,232 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:19,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,234 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,234 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,234 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:19,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:19,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:19,235 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:19,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:19,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:19,235 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:19,235 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:19,234 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,235 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:19,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:19,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:19,235 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:19,235 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,235 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,235 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,235 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,335 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:19,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:19,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:19,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:19,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,343 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:19,343 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:19,343 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:19,343 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:19,343 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,344 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,344 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,344 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:19,345 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:19,345 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:19,345 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,345 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:19,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,345 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,346 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:19,346 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:19,346 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:19,346 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:19,346 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:19,346 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:19,346 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:19,346 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:19,346 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:19,346 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:19,767 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120575fb5c1f3cf1472eb4e75af5de2ff834 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120575fb5c1f3cf1472eb4e75af5de2ff834 2023-10-29 15:53:20,175 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/13fe23505c4445619d4f6e64f9a8c57d 2023-10-29 15:53:20,189 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/13fe23505c4445619d4f6e64f9a8c57d as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/13fe23505c4445619d4f6e64f9a8c57d 2023-10-29 15:53:20,197 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/13fe23505c4445619d4f6e64f9a8c57d, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 15:53:20,198 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 852ms, sequenceid=17, compaction requested=true 2023-10-29 15:53:20,199 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:20,199 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:20,199 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:20,199 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:20,199 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,199 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:20,199 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:20,201 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,201 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:20,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:20,202 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,202 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:20,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:20,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:20,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:20,205 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@49a10686[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:20,205 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:20,205 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,206 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:20,206 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:20,206 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:20,208 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:20,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,208 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:20,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:20,208 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:20,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:20,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:20,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:20,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:20,214 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:20,214 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:20,214 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:20,214 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,214 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:20,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:20,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:20,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:20,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:20,224 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:20,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,226 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:20,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,231 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,231 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:20,231 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:20,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:20,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:20,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:20,231 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:20,231 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:20,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:20,231 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,232 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:20,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:20,232 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:20,232 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:20,233 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,233 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,233 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,333 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:20,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:20,346 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:20,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:20,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,350 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:20,350 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:20,350 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:20,350 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:20,352 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,352 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,354 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:20,354 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:20,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:20,355 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:20,355 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:20,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,356 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:20,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,358 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,358 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:20,358 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:20,358 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:20,359 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:20,359 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:20,359 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:20,359 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:20,359 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:20,359 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:20,360 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:20,785 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228d86bf6662bf14da3ba17023123321f94 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228d86bf6662bf14da3ba17023123321f94 2023-10-29 15:53:20,914 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:53:21,193 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/1419a635b8ac430b8e09705d10bb70c9 2023-10-29 15:53:21,207 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/1419a635b8ac430b8e09705d10bb70c9 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/1419a635b8ac430b8e09705d10bb70c9 2023-10-29 15:53:21,214 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/1419a635b8ac430b8e09705d10bb70c9, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 15:53:21,215 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 856ms, sequenceid=21, compaction requested=true 2023-10-29 15:53:21,215 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:21,215 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:21,215 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:21,215 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:21,215 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,215 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:21,216 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:21,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:21,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:21,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:21,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:21,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:21,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:21,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:21,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@22d91353[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:21,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:21,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,221 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:21,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:21,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:21,221 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,221 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:21,222 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:21,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,222 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:21,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:21,222 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:21,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:21,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:21,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:21,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:21,226 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:21,226 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:21,226 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:21,226 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,226 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:21,247 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,247 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:21,248 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,247 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:21,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:21,249 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:21,249 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:21,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,252 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:21,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,256 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,256 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,256 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,256 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,256 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:21,256 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:21,256 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:21,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:21,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:21,256 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,257 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,257 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,256 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:21,256 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:21,257 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:21,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:21,257 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:21,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:21,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:21,357 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:21,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:21,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:21,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:21,375 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,375 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:21,375 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:21,375 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:21,375 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:21,377 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,377 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,378 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,378 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:21,379 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:21,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:21,379 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:21,379 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:21,380 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,381 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:21,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,382 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,382 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:21,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:21,382 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:21,382 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:21,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:21,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:21,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:21,383 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:21,384 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:21,384 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:21,806 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f5f0d14a843c4579b7cb8d559ec04c66 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231f5f0d14a843c4579b7cb8d559ec04c66 2023-10-29 15:53:22,214 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/9be04159f0a04458a24b6e65d97b8d11 2023-10-29 15:53:22,224 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/9be04159f0a04458a24b6e65d97b8d11 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/9be04159f0a04458a24b6e65d97b8d11 2023-10-29 15:53:22,231 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/9be04159f0a04458a24b6e65d97b8d11, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 15:53:22,232 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 848ms, sequenceid=25, compaction requested=true 2023-10-29 15:53:22,232 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:22,233 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:22,233 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:22,233 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:22,233 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,233 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:22,233 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:22,235 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:22,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:22,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:22,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:22,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:22,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:22,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23555656[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:22,238 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:22,238 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,247 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,247 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:22,247 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:22,248 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:22,248 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,248 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:22,255 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:22,255 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,255 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:22,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:22,255 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:22,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:22,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:22,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:22,261 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:22,261 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:22,261 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:22,261 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:22,261 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,261 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:22,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:22,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:22,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,265 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:22,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:22,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,268 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:22,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,273 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,273 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:22,273 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:22,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:22,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:22,273 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,273 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:22,274 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:22,274 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:22,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:22,273 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:22,274 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,275 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,275 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,275 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:22,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:22,375 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:22,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:22,387 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:22,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:22,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,390 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:22,390 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:22,390 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:22,390 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:22,391 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,391 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,392 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:22,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:22,392 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:22,393 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,393 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,394 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,394 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:22,395 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:22,395 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:22,395 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:22,395 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:22,395 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:22,395 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:22,395 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:22,395 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:22,395 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:22,811 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010d20b942a74746ce82e89c1a7ee41641 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010d20b942a74746ce82e89c1a7ee41641 2023-10-29 15:53:23,221 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/58c5f68000a44e96a4abd6e562f4d84e 2023-10-29 15:53:23,234 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/58c5f68000a44e96a4abd6e562f4d84e as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/58c5f68000a44e96a4abd6e562f4d84e 2023-10-29 15:53:23,240 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/58c5f68000a44e96a4abd6e562f4d84e, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 15:53:23,241 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 846ms, sequenceid=29, compaction requested=true 2023-10-29 15:53:23,241 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:23,241 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:23,241 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:23,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,243 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:23,243 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,243 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:23,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:23,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:23,246 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@578207f[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:23,246 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:23,246 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,247 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,247 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,247 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:23,247 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:23,247 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:23,247 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,247 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:23,248 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:23,248 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,248 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:23,249 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:23,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:23,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:23,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:23,252 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:23,252 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:23,252 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:23,252 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:23,252 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,252 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:23,262 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,262 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,262 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:23,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:23,263 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:23,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,265 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,270 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,270 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:23,270 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,270 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:23,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:23,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:23,270 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,270 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:23,270 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:23,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:23,271 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,271 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,271 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,271 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,271 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:23,272 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:23,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:23,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:23,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:23,372 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:23,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:23,385 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:23,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:23,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,387 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:23,387 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:23,387 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:23,387 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:23,388 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,388 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,389 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:23,389 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:23,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:23,390 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:23,390 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:23,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:23,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,391 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,391 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:23,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:23,391 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:23,391 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:23,391 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:23,391 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:23,391 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:23,391 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:23,391 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:23,391 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:23,808 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103825c1dbd043340e681e736fbf57ada51 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103825c1dbd043340e681e736fbf57ada51 2023-10-29 15:53:24,217 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/22170b4b8a204774ba22be6680cfdf6c 2023-10-29 15:53:24,223 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/22170b4b8a204774ba22be6680cfdf6c as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/22170b4b8a204774ba22be6680cfdf6c 2023-10-29 15:53:24,229 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/22170b4b8a204774ba22be6680cfdf6c, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 15:53:24,230 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 839ms, sequenceid=33, compaction requested=true 2023-10-29 15:53:24,230 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:24,230 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:24,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:24,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:24,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:24,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:24,231 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,231 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:24,232 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,232 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:24,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:24,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:24,233 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@44ac8360[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:24,233 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:24,233 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,234 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,234 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:24,234 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:24,234 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,234 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:24,234 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:24,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:24,235 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:24,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:24,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:24,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:24,238 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:24,238 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:24,238 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:24,238 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,238 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:24,239 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,239 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:24,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,239 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:24,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:24,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:24,240 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,241 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:24,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:24,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,243 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:24,243 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:24,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:24,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:24,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:24,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:24,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:24,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,244 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,244 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:24,244 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:24,244 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:24,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:24,344 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:24,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:24,349 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:24,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:24,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,351 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:24,351 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:24,351 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:24,351 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:24,352 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,352 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,353 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:24,353 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:24,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:24,353 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:24,353 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:24,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,354 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:24,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,354 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,354 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:24,354 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:24,354 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:24,354 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:24,354 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:24,355 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:24,355 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:24,355 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:24,355 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:24,355 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:24,775 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907457de937749743b88e9bd8432c29c3eb to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907457de937749743b88e9bd8432c29c3eb 2023-10-29 15:53:25,184 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/fe11011b6df6469495d5fb76b041ab72 2023-10-29 15:53:25,197 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/fe11011b6df6469495d5fb76b041ab72 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/fe11011b6df6469495d5fb76b041ab72 2023-10-29 15:53:25,202 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/fe11011b6df6469495d5fb76b041ab72, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 15:53:25,203 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 848ms, sequenceid=37, compaction requested=true 2023-10-29 15:53:25,203 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:25,203 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:25,203 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:25,203 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:25,203 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,203 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:25,203 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:25,204 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,204 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:25,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:25,205 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,205 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:25,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:25,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:25,207 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e85432d[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:25,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:25,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,209 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,210 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:25,210 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:25,210 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:25,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:25,211 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:25,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:25,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:25,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:25,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:25,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:25,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:25,214 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:25,214 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:25,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:25,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:25,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,215 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:25,220 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,220 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,220 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:25,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:25,221 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:25,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:25,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,223 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,225 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,225 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,225 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:25,225 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,225 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:25,225 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:25,225 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:25,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:25,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:25,226 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:25,225 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:25,225 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,226 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:25,226 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,226 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:25,226 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:25,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:25,226 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,326 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:25,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:25,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:25,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:25,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,337 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:25,337 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:25,337 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:25,337 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:25,338 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,338 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,340 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:25,340 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,340 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:25,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:25,341 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:25,341 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:25,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,342 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:25,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,343 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,343 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:25,343 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:25,343 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:25,344 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:25,344 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:25,344 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:25,344 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:25,344 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:25,344 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. started... 2023-10-29 15:53:25,344 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 82f7ba83074cecf15632fcdb3ca381e8 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:25,772 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120c95929cee779436ca90c63efb5845490 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151120c95929cee779436ca90c63efb5845490 2023-10-29 15:53:26,180 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/847e7092b0f14062a1d2ccfb9bc4274d 2023-10-29 15:53:26,195 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/847e7092b0f14062a1d2ccfb9bc4274d as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/847e7092b0f14062a1d2ccfb9bc4274d 2023-10-29 15:53:26,203 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/847e7092b0f14062a1d2ccfb9bc4274d, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 15:53:26,204 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 82f7ba83074cecf15632fcdb3ca381e8 in 860ms, sequenceid=41, compaction requested=true 2023-10-29 15:53:26,204 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:26,204 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:26,204 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:26,204 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:26,204 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,205 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:26,205 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:26,206 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,206 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:26,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:26,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,207 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:26,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:26,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:26,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:26,209 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@276b474d[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:26,209 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:26,209 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,210 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,210 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:26,210 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:26,210 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:26,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:26,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:26,211 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:26,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:26,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:26,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:26,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:26,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:26,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:26,215 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:26,215 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:26,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:26,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:26,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,215 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:26,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,217 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,217 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:26,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:26,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:26,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:26,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:26,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:26,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:26,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:26,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,222 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-10-29 15:53:26,223 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:26,222 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:26,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:26,222 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:26,222 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,223 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:26,223 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:26,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:26,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:26,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:26,323 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:26,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:26,326 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-10-29 15:53:26,328 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:26,328 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:26,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:26,329 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595406329 2023-10-29 15:53:26,333 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 15:53:26,335 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-29 15:53:26,335 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:26,337 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x07be110c to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:53:26,341 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d283592, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:53:26,342 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,188 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010303ec496a311747ef892e487499a7619b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010303ec496a311747ef892e487499a7619b 2023-10-29 15:53:27,190 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:27,203 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:53:27,204 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:37536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:53:27,210 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:53:27,212 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:54528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:53:27,222 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/fabf8326c1cf49409d917948ab60593b first=Optional[r3] last=Optional[r6] 2023-10-29 15:53:27,222 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/fabf8326c1cf49409d917948ab60593b}] 2023-10-29 15:53:27,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/fabf8326c1cf49409d917948ab60593b for inclusion in 82f7ba83074cecf15632fcdb3ca381e8/family1 2023-10-29 15:53:27,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 15:53:27,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:27,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:27,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/fabf8326c1cf49409d917948ab60593b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__l8kfk048h5gqhie65espgadbu13v5vt6k5jdffmr0p5euosuehqeuab372q3q0d8/family1/fabf8326c1cf49409d917948ab60593b 2023-10-29 15:53:27,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__l8kfk048h5gqhie65espgadbu13v5vt6k5jdffmr0p5euosuehqeuab372q3q0d8/family1/fabf8326c1cf49409d917948ab60593b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/0ef38608e9b846758570acf265e7c03c_SeqId_44_ 2023-10-29 15:53:27,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__l8kfk048h5gqhie65espgadbu13v5vt6k5jdffmr0p5euosuehqeuab372q3q0d8/family1/fabf8326c1cf49409d917948ab60593b into 82f7ba83074cecf15632fcdb3ca381e8/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/0ef38608e9b846758570acf265e7c03c_SeqId_44_ - updating store file list. 2023-10-29 15:53:27,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/0ef38608e9b846758570acf265e7c03c_SeqId_44_ into 82f7ba83074cecf15632fcdb3ca381e8/family1 2023-10-29 15:53:27,244 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__l8kfk048h5gqhie65espgadbu13v5vt6k5jdffmr0p5euosuehqeuab372q3q0d8/family1/fabf8326c1cf49409d917948ab60593b into 82f7ba83074cecf15632fcdb3ca381e8/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/0ef38608e9b846758570acf265e7c03c_SeqId_44_) 2023-10-29 15:53:27,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__l8kfk048h5gqhie65espgadbu13v5vt6k5jdffmr0p5euosuehqeuab372q3q0d8/family1/fabf8326c1cf49409d917948ab60593b 2023-10-29 15:53:27,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 15:53:27,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 15:53:27,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): 82f7ba83074cecf15632fcdb3ca381e8/family1 is initiating minor compaction 2023-10-29 15:53:27,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7d59eb0; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:27,247 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 82f7ba83074cecf15632fcdb3ca381e8/family1 in testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:53:27,248 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/319b51c149624e8aae3814fadd2d9a44, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/7efae1ce69624b5db36f2e8ebee7b87e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/13fe23505c4445619d4f6e64f9a8c57d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/1419a635b8ac430b8e09705d10bb70c9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/9be04159f0a04458a24b6e65d97b8d11, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/58c5f68000a44e96a4abd6e562f4d84e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/22170b4b8a204774ba22be6680cfdf6c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/fe11011b6df6469495d5fb76b041ab72, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/847e7092b0f14062a1d2ccfb9bc4274d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/0ef38608e9b846758570acf265e7c03c_SeqId_44_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp, totalSize=50.0 K 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 319b51c149624e8aae3814fadd2d9a44, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 7efae1ce69624b5db36f2e8ebee7b87e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 13fe23505c4445619d4f6e64f9a8c57d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 1419a635b8ac430b8e09705d10bb70c9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 9be04159f0a04458a24b6e65d97b8d11, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 58c5f68000a44e96a4abd6e562f4d84e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 22170b4b8a204774ba22be6680cfdf6c, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting fe11011b6df6469495d5fb76b041ab72, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 15:53:27,248 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 847e7092b0f14062a1d2ccfb9bc4274d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 15:53:27,249 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 0ef38608e9b846758570acf265e7c03c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 15:53:27,249 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:27,250 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:27,252 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228d86bf6662bf14da3ba17023123321f94 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151228d86bf6662bf14da3ba17023123321f94 2023-10-29 15:53:27,254 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231f5f0d14a843c4579b7cb8d559ec04c66 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231f5f0d14a843c4579b7cb8d559ec04c66 2023-10-29 15:53:27,255 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010d20b942a74746ce82e89c1a7ee41641 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601010d20b942a74746ce82e89c1a7ee41641 2023-10-29 15:53:27,256 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103825c1dbd043340e681e736fbf57ada51 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103825c1dbd043340e681e736fbf57ada51 2023-10-29 15:53:27,256 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-29 15:53:27,256 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 15:53:27,256 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,256 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,256 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,257 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,257 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,257 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,257 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,257 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,290 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 82f7ba83074cecf15632fcdb3ca381e8#family1#compaction#34 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:27,707 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c90373acdc9f412d848c21b555b59ca7 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205c90373acdc9f412d848c21b555b59ca7 2023-10-29 15:53:27,708 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:27,732 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a69311213ba4e50b2fedd196d322051 first=Optional[r1] last=Optional[r2] 2023-10-29 15:53:27,733 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a69311213ba4e50b2fedd196d322051}] 2023-10-29 15:53:27,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a69311213ba4e50b2fedd196d322051 for inclusion in 82f7ba83074cecf15632fcdb3ca381e8/family1 2023-10-29 15:53:27,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-29 15:53:27,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:27,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:27,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/3a69311213ba4e50b2fedd196d322051 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m3l1tlrflv9iockp9a2jecsnbbnih3usinbcu8d7mavlfa9rop2omavrb7i40dt2/family1/3a69311213ba4e50b2fedd196d322051 2023-10-29 15:53:27,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m3l1tlrflv9iockp9a2jecsnbbnih3usinbcu8d7mavlfa9rop2omavrb7i40dt2/family1/3a69311213ba4e50b2fedd196d322051 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/c29069a870df4eb3a8f2794c2e2a661f_SeqId_46_ 2023-10-29 15:53:27,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m3l1tlrflv9iockp9a2jecsnbbnih3usinbcu8d7mavlfa9rop2omavrb7i40dt2/family1/3a69311213ba4e50b2fedd196d322051 into 82f7ba83074cecf15632fcdb3ca381e8/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/c29069a870df4eb3a8f2794c2e2a661f_SeqId_46_ - updating store file list. 2023-10-29 15:53:27,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/c29069a870df4eb3a8f2794c2e2a661f_SeqId_46_ into 82f7ba83074cecf15632fcdb3ca381e8/family1 2023-10-29 15:53:27,752 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m3l1tlrflv9iockp9a2jecsnbbnih3usinbcu8d7mavlfa9rop2omavrb7i40dt2/family1/3a69311213ba4e50b2fedd196d322051 into 82f7ba83074cecf15632fcdb3ca381e8/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/c29069a870df4eb3a8f2794c2e2a661f_SeqId_46_) 2023-10-29 15:53:27,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithWeeklyPolicy__m3l1tlrflv9iockp9a2jecsnbbnih3usinbcu8d7mavlfa9rop2omavrb7i40dt2/family1/3a69311213ba4e50b2fedd196d322051 2023-10-29 15:53:27,755 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:27,755 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:27,757 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120168a88cef4afd485ebe6b4dba60e91c2e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120168a88cef4afd485ebe6b4dba60e91c2e 2023-10-29 15:53:27,758 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120575fb5c1f3cf1472eb4e75af5de2ff834 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2015120575fb5c1f3cf1472eb4e75af5de2ff834 2023-10-29 15:53:27,758 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-10-29 15:53:27,758 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 15:53:27,759 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:27,759 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:27,759 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:27,760 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:27,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4340 sec 2023-10-29 15:53:27,875 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=259 (was 255) - Thread LEAK? -, OpenFileDescriptor=620 (was 607) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 333), ProcessCount=168 (was 168), AvailableMemoryMB=3207 (was 3298) 2023-10-29 15:53:27,885 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259, OpenFileDescriptor=620, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=168, AvailableMemoryMB=3206 2023-10-29 15:53:27,887 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 15:53:27,888 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:27,890 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:53:27,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-10-29 15:53:27,891 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:53:27,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 15:53:27,893 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698 2023-10-29 15:53:27,893 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:27,893 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:27,894 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698 empty. 2023-10-29 15:53:27,894 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47 empty. 2023-10-29 15:53:27,894 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab empty. 2023-10-29 15:53:27,894 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698 2023-10-29 15:53:27,894 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:27,894 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:27,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-10-29 15:53:27,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 15:53:28,118 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/.tmp/family1/6c8b18a236e44b228b009ae836343489 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/6c8b18a236e44b228b009ae836343489 2023-10-29 15:53:28,126 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 82f7ba83074cecf15632fcdb3ca381e8/family1 of 82f7ba83074cecf15632fcdb3ca381e8 into 6c8b18a236e44b228b009ae836343489(size=6.6 K), total size for store is 176.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:53:28,127 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:53:28,127 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698594807247; duration=0sec 2023-10-29 15:53:28,127 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:28,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/319b51c149624e8aae3814fadd2d9a44, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/7efae1ce69624b5db36f2e8ebee7b87e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/13fe23505c4445619d4f6e64f9a8c57d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/1419a635b8ac430b8e09705d10bb70c9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/9be04159f0a04458a24b6e65d97b8d11, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/58c5f68000a44e96a4abd6e562f4d84e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/22170b4b8a204774ba22be6680cfdf6c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/fe11011b6df6469495d5fb76b041ab72, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/847e7092b0f14062a1d2ccfb9bc4274d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/0ef38608e9b846758570acf265e7c03c_SeqId_44_] to archive 2023-10-29 15:53:28,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 15:53:28,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:28,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/319b51c149624e8aae3814fadd2d9a44 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/319b51c149624e8aae3814fadd2d9a44 2023-10-29 15:53:28,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/7efae1ce69624b5db36f2e8ebee7b87e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/7efae1ce69624b5db36f2e8ebee7b87e 2023-10-29 15:53:28,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/13fe23505c4445619d4f6e64f9a8c57d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/13fe23505c4445619d4f6e64f9a8c57d 2023-10-29 15:53:28,200 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/1419a635b8ac430b8e09705d10bb70c9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/1419a635b8ac430b8e09705d10bb70c9 2023-10-29 15:53:28,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/9be04159f0a04458a24b6e65d97b8d11 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/9be04159f0a04458a24b6e65d97b8d11 2023-10-29 15:53:28,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/58c5f68000a44e96a4abd6e562f4d84e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/58c5f68000a44e96a4abd6e562f4d84e 2023-10-29 15:53:28,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/22170b4b8a204774ba22be6680cfdf6c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/22170b4b8a204774ba22be6680cfdf6c 2023-10-29 15:53:28,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/fe11011b6df6469495d5fb76b041ab72 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/fe11011b6df6469495d5fb76b041ab72 2023-10-29 15:53:28,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/847e7092b0f14062a1d2ccfb9bc4274d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/847e7092b0f14062a1d2ccfb9bc4274d 2023-10-29 15:53:28,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/0ef38608e9b846758570acf265e7c03c_SeqId_44_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/family1/0ef38608e9b846758570acf265e7c03c_SeqId_44_ 2023-10-29 15:53:28,307 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-10-29 15:53:28,310 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 31876b3a451adf46a64169be782d0698, NAME => 'testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:53:28,310 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 3a1649507b121e0e15742780ce4ccaab, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:53:28,311 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4d95aaa94c99dcf0220866a609727b47, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:53:28,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 15:53:28,722 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:28,722 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 31876b3a451adf46a64169be782d0698, disabling compactions & flushes 2023-10-29 15:53:28,723 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:28,723 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:28,723 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. after waiting 0 ms 2023-10-29 15:53:28,723 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:28,723 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:28,723 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 31876b3a451adf46a64169be782d0698: 2023-10-29 15:53:28,724 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:28,724 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 3a1649507b121e0e15742780ce4ccaab, disabling compactions & flushes 2023-10-29 15:53:28,724 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:28,724 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:28,725 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. after waiting 0 ms 2023-10-29 15:53:28,725 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:28,725 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:28,725 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 4d95aaa94c99dcf0220866a609727b47, disabling compactions & flushes 2023-10-29 15:53:28,725 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:28,725 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:28,726 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 3a1649507b121e0e15742780ce4ccaab: 2023-10-29 15:53:28,726 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:28,726 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. after waiting 0 ms 2023-10-29 15:53:28,726 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:28,726 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:28,726 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 4d95aaa94c99dcf0220866a609727b47: 2023-10-29 15:53:28,731 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:53:28,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698594808732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594808732"}]},"ts":"1698594808732"} 2023-10-29 15:53:28,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698594808732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594808732"}]},"ts":"1698594808732"} 2023-10-29 15:53:28,732 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698594808732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594808732"}]},"ts":"1698594808732"} 2023-10-29 15:53:28,734 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 15:53:28,735 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:53:28,735 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594808735"}]},"ts":"1698594808735"} 2023-10-29 15:53:28,736 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-10-29 15:53:28,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=31876b3a451adf46a64169be782d0698, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4d95aaa94c99dcf0220866a609727b47, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3a1649507b121e0e15742780ce4ccaab, ASSIGN}] 2023-10-29 15:53:28,740 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3a1649507b121e0e15742780ce4ccaab, ASSIGN 2023-10-29 15:53:28,740 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4d95aaa94c99dcf0220866a609727b47, ASSIGN 2023-10-29 15:53:28,740 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=31876b3a451adf46a64169be782d0698, ASSIGN 2023-10-29 15:53:28,741 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3a1649507b121e0e15742780ce4ccaab, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:53:28,741 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=31876b3a451adf46a64169be782d0698, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:53:28,741 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4d95aaa94c99dcf0220866a609727b47, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:53:28,893 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4d95aaa94c99dcf0220866a609727b47, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:28,893 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=3a1649507b121e0e15742780ce4ccaab, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:28,893 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=31876b3a451adf46a64169be782d0698, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:28,893 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698594808893"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594808893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594808893"}]},"ts":"1698594808893"} 2023-10-29 15:53:28,893 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698594808893"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594808893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594808893"}]},"ts":"1698594808893"} 2023-10-29 15:53:28,893 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698594808893"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594808893"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594808893"}]},"ts":"1698594808893"} 2023-10-29 15:53:28,896 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 4d95aaa94c99dcf0220866a609727b47, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:28,897 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 31876b3a451adf46a64169be782d0698, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:28,899 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=33, ppid=30, state=RUNNABLE; OpenRegionProcedure 3a1649507b121e0e15742780ce4ccaab, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:28,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 15:53:29,050 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:29,056 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:29,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3a1649507b121e0e15742780ce4ccaab, NAME => 'testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 15:53:29,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:29,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:29,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:29,058 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:29,061 INFO [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:29,063 DEBUG [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1 2023-10-29 15:53:29,063 DEBUG [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1 2023-10-29 15:53:29,064 INFO [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1649507b121e0e15742780ce4ccaab columnFamilyName family1 2023-10-29 15:53:29,065 INFO [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] regionserver.HStore(310): Store=3a1649507b121e0e15742780ce4ccaab/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:29,066 INFO [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:29,067 DEBUG [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family2 2023-10-29 15:53:29,067 DEBUG [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family2 2023-10-29 15:53:29,067 INFO [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3a1649507b121e0e15742780ce4ccaab columnFamilyName family2 2023-10-29 15:53:29,069 INFO [StoreOpener-3a1649507b121e0e15742780ce4ccaab-1] regionserver.HStore(310): Store=3a1649507b121e0e15742780ce4ccaab/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:29,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:29,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:29,072 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:53:29,073 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:53:29,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:53:29,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3a1649507b121e0e15742780ce4ccaab; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69383297, jitterRate=0.033891692757606506}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:53:29,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3a1649507b121e0e15742780ce4ccaab: 2023-10-29 15:53:29,076 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab., pid=33, masterSystemTime=1698594809050 2023-10-29 15:53:29,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:29,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:29,078 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:29,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31876b3a451adf46a64169be782d0698, NAME => 'testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 15:53:29,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 31876b3a451adf46a64169be782d0698 2023-10-29 15:53:29,078 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=3a1649507b121e0e15742780ce4ccaab, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:29,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:29,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 31876b3a451adf46a64169be782d0698 2023-10-29 15:53:29,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 31876b3a451adf46a64169be782d0698 2023-10-29 15:53:29,079 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698594809078"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594809078"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594809078"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594809078"}]},"ts":"1698594809078"} 2023-10-29 15:53:29,080 INFO [StoreOpener-31876b3a451adf46a64169be782d0698-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 31876b3a451adf46a64169be782d0698 2023-10-29 15:53:29,082 DEBUG [StoreOpener-31876b3a451adf46a64169be782d0698-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698/family1 2023-10-29 15:53:29,082 DEBUG [StoreOpener-31876b3a451adf46a64169be782d0698-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698/family1 2023-10-29 15:53:29,082 INFO [StoreOpener-31876b3a451adf46a64169be782d0698-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31876b3a451adf46a64169be782d0698 columnFamilyName family1 2023-10-29 15:53:29,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=33, resume processing ppid=30 2023-10-29 15:53:29,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, ppid=30, state=SUCCESS; OpenRegionProcedure 3a1649507b121e0e15742780ce4ccaab, server=jenkins-hbase20.apache.org,44603,1698594767651 in 182 msec 2023-10-29 15:53:29,083 INFO [StoreOpener-31876b3a451adf46a64169be782d0698-1] regionserver.HStore(310): Store=31876b3a451adf46a64169be782d0698/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:29,084 INFO [StoreOpener-31876b3a451adf46a64169be782d0698-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 31876b3a451adf46a64169be782d0698 2023-10-29 15:53:29,084 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3a1649507b121e0e15742780ce4ccaab, ASSIGN in 345 msec 2023-10-29 15:53:29,085 DEBUG [StoreOpener-31876b3a451adf46a64169be782d0698-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698/family2 2023-10-29 15:53:29,085 DEBUG [StoreOpener-31876b3a451adf46a64169be782d0698-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698/family2 2023-10-29 15:53:29,086 INFO [StoreOpener-31876b3a451adf46a64169be782d0698-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31876b3a451adf46a64169be782d0698 columnFamilyName family2 2023-10-29 15:53:29,087 INFO [StoreOpener-31876b3a451adf46a64169be782d0698-1] regionserver.HStore(310): Store=31876b3a451adf46a64169be782d0698/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:29,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698 2023-10-29 15:53:29,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698 2023-10-29 15:53:29,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:53:29,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 31876b3a451adf46a64169be782d0698 2023-10-29 15:53:29,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:53:29,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 31876b3a451adf46a64169be782d0698; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73209630, jitterRate=0.09090849757194519}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:53:29,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 31876b3a451adf46a64169be782d0698: 2023-10-29 15:53:29,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698., pid=32, masterSystemTime=1698594809050 2023-10-29 15:53:29,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:29,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:29,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:29,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4d95aaa94c99dcf0220866a609727b47, NAME => 'testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 15:53:29,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:29,097 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=31876b3a451adf46a64169be782d0698, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:29,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:29,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:29,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:29,097 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1698594809097"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594809097"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594809097"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594809097"}]},"ts":"1698594809097"} 2023-10-29 15:53:29,099 INFO [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:29,101 DEBUG [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47/family1 2023-10-29 15:53:29,101 DEBUG [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47/family1 2023-10-29 15:53:29,102 INFO [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d95aaa94c99dcf0220866a609727b47 columnFamilyName family1 2023-10-29 15:53:29,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=32, resume processing ppid=28 2023-10-29 15:53:29,102 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 31876b3a451adf46a64169be782d0698, server=jenkins-hbase20.apache.org,44603,1698594767651 in 202 msec 2023-10-29 15:53:29,103 INFO [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] regionserver.HStore(310): Store=4d95aaa94c99dcf0220866a609727b47/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:29,104 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=31876b3a451adf46a64169be782d0698, ASSIGN in 364 msec 2023-10-29 15:53:29,104 INFO [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:29,105 DEBUG [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47/family2 2023-10-29 15:53:29,105 DEBUG [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47/family2 2023-10-29 15:53:29,106 INFO [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4d95aaa94c99dcf0220866a609727b47 columnFamilyName family2 2023-10-29 15:53:29,107 INFO [StoreOpener-4d95aaa94c99dcf0220866a609727b47-1] regionserver.HStore(310): Store=4d95aaa94c99dcf0220866a609727b47/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:29,107 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:29,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:29,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:53:29,110 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:53:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:53:29,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4d95aaa94c99dcf0220866a609727b47; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68941886, jitterRate=0.02731415629386902}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:53:29,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4d95aaa94c99dcf0220866a609727b47: 2023-10-29 15:53:29,113 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47., pid=31, masterSystemTime=1698594809050 2023-10-29 15:53:29,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:29,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:29,115 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=4d95aaa94c99dcf0220866a609727b47, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:29,115 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1698594809115"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594809115"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594809115"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594809115"}]},"ts":"1698594809115"} 2023-10-29 15:53:29,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-10-29 15:53:29,119 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 4d95aaa94c99dcf0220866a609727b47, server=jenkins-hbase20.apache.org,44603,1698594767651 in 220 msec 2023-10-29 15:53:29,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-10-29 15:53:29,121 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=4d95aaa94c99dcf0220866a609727b47, ASSIGN in 381 msec 2023-10-29 15:53:29,122 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:53:29,122 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594809122"}]},"ts":"1698594809122"} 2023-10-29 15:53:29,124 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-10-29 15:53:29,126 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:53:29,128 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2380 sec 2023-10-29 15:53:30,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-10-29 15:53:30,002 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-10-29 15:53:30,020 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:30,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,024 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-29 15:53:30,024 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:30,024 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-29 15:53:30,024 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-29 15:53:30,025 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,025 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,027 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:30,027 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:30,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:30,028 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,028 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:30,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,029 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:30,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,030 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,030 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,030 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-29 15:53:30,030 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:30,030 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-29 15:53:30,031 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:30,031 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:30,031 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. started... 2023-10-29 15:53:30,031 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. started... 2023-10-29 15:53:30,035 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:53:30,035 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:30,035 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:30,035 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4d95aaa94c99dcf0220866a609727b47: 2023-10-29 15:53:30,035 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:30,035 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3a1649507b121e0e15742780ce4ccaab 2/2 column families, dataSize=48 B heapSize=632 B 2023-10-29 15:53:30,035 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:53:30,035 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. started... 2023-10-29 15:53:30,036 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 31876b3a451adf46a64169be782d0698: 2023-10-29 15:53:30,036 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:30,036 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:53:30,454 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029c95ac91614e040259c16b96859058cd9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029c95ac91614e040259c16b96859058cd9 2023-10-29 15:53:30,864 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/.tmp/family1/8c974acbea3a4bcb9955d39be15a0566 2023-10-29 15:53:30,878 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/.tmp/family1/8c974acbea3a4bcb9955d39be15a0566 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/8c974acbea3a4bcb9955d39be15a0566 2023-10-29 15:53:30,887 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/8c974acbea3a4bcb9955d39be15a0566, entries=1, sequenceid=5, filesize=4.9 K 2023-10-29 15:53:30,888 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 3a1649507b121e0e15742780ce4ccaab in 853ms, sequenceid=5, compaction requested=false 2023-10-29 15:53:30,888 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-10-29 15:53:30,889 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3a1649507b121e0e15742780ce4ccaab: 2023-10-29 15:53:30,889 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:30,889 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:53:30,889 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:53:30,889 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,889 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-29 15:53:30,889 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-29 15:53:30,890 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,890 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:30,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:30,891 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,891 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:30,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:30,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:30,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:30,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-29 15:53:30,893 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63d4e007[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:30,893 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-29 15:53:30,893 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,893 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,894 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-29 15:53:30,894 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-29 15:53:30,894 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:30,894 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,894 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:30,895 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,895 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-29 15:53:30,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:30,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:30,895 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:30,895 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-29 15:53:30,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:30,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:30,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:30,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:30,898 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-29 15:53:30,898 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-29 15:53:30,898 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:30,898 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:30,898 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,898 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:30,899 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,899 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:30,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,900 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:30,900 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:30,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:30,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:30,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:30,902 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:30,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:30,905 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:30,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:30,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-29 15:53:30,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,905 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-10-29 15:53:30,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:30,905 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:30,905 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:30,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:31,006 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:31,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:31,016 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:31,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:31,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,021 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-10-29 15:53:31,021 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:31,021 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-10-29 15:53:31,021 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-10-29 15:53:31,022 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,022 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,024 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,024 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:31,024 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:31,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:31,025 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,025 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:31,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,026 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,027 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,028 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-10-29 15:53:31,028 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,028 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-10-29 15:53:31,028 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:31,028 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-10-29 15:53:31,029 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:31,029 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. started... 2023-10-29 15:53:31,029 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:31,030 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 4d95aaa94c99dcf0220866a609727b47: 2023-10-29 15:53:31,030 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:53:31,030 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:31,030 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. started... 2023-10-29 15:53:31,030 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:53:31,030 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3a1649507b121e0e15742780ce4ccaab 2/2 column families, dataSize=90 B heapSize=752 B 2023-10-29 15:53:31,030 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:31,030 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. started... 2023-10-29 15:53:31,030 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:53:31,030 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 31876b3a451adf46a64169be782d0698: 2023-10-29 15:53:31,030 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:53:31,031 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:53:31,447 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029b9abcd0c35bb4244a681de825d56b345 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029b9abcd0c35bb4244a681de825d56b345 2023-10-29 15:53:31,856 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/.tmp/family1/394112e80bb9421aa6d943e96f0b1d4b 2023-10-29 15:53:31,868 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/.tmp/family1/394112e80bb9421aa6d943e96f0b1d4b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/394112e80bb9421aa6d943e96f0b1d4b 2023-10-29 15:53:31,875 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/394112e80bb9421aa6d943e96f0b1d4b, entries=2, sequenceid=9, filesize=5.0 K 2023-10-29 15:53:31,877 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 3a1649507b121e0e15742780ce4ccaab in 847ms, sequenceid=9, compaction requested=false 2023-10-29 15:53:31,878 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3a1649507b121e0e15742780ce4ccaab: 2023-10-29 15:53:31,878 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:31,878 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:53:31,878 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:53:31,878 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,878 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-10-29 15:53:31,878 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-10-29 15:53:31,881 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,881 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:31,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:31,881 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,881 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:31,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:31,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:31,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:31,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-10-29 15:53:31,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4343c89e[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:31,885 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-10-29 15:53:31,885 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,886 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,887 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-10-29 15:53:31,887 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-10-29 15:53:31,887 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:31,887 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,887 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:31,887 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-10-29 15:53:31,887 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,887 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:31,888 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-10-29 15:53:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:31,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:31,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:31,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-10-29 15:53:31,890 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-10-29 15:53:31,890 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:31,890 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:31,890 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,890 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:31,891 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,891 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:31,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:31,891 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:31,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:31,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:31,891 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:31,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:31,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,892 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:31,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:31,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:31,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-10-29 15:53:31,894 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:31,894 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,894 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:31,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:31,894 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,895 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:31,895 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:31,995 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:31,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:32,012 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-10-29 15:53:32,013 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 15:53:32,014 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 15:53:32,015 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595412015 2023-10-29 15:53:32,015 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:32,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:53:32,016 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-10-29 15:53:32,017 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 15:53:32,018 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x6370cf0a to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:53:32,022 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f78e253, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:53:32,023 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-29 15:53:32,863 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029176f090e3f2d4039b84562cd281b39c0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029176f090e3f2d4039b84562cd281b39c0 2023-10-29 15:53:32,864 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 15:53:32,878 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:53:32,879 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:48666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:53:32,886 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:53:32,888 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:53:32,899 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/93a7ab8d9514446b987dbbed24959827 first=Optional[k0] last=Optional[k1] 2023-10-29 15:53:32,900 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/93a7ab8d9514446b987dbbed24959827}] 2023-10-29 15:53:32,905 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/93a7ab8d9514446b987dbbed24959827 for inclusion in 3a1649507b121e0e15742780ce4ccaab/family1 2023-10-29 15:53:32,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-10-29 15:53:32,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 15:53:32,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 3a1649507b121e0e15742780ce4ccaab: 2023-10-29 15:53:32,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029/family1/93a7ab8d9514446b987dbbed24959827 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testScannerOnBulkLoadRefHFiles__fbvtf7bko787ls28s0ethtcrstte346j2943o3t43luhrqmfmkrr7c1mfftt98la/family1/93a7ab8d9514446b987dbbed24959827 2023-10-29 15:53:32,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testScannerOnBulkLoadRefHFiles__fbvtf7bko787ls28s0ethtcrstte346j2943o3t43luhrqmfmkrr7c1mfftt98la/family1/93a7ab8d9514446b987dbbed24959827 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_ 2023-10-29 15:53:32,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testScannerOnBulkLoadRefHFiles__fbvtf7bko787ls28s0ethtcrstte346j2943o3t43luhrqmfmkrr7c1mfftt98la/family1/93a7ab8d9514446b987dbbed24959827 into 3a1649507b121e0e15742780ce4ccaab/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_ - updating store file list. 2023-10-29 15:53:32,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_ into 3a1649507b121e0e15742780ce4ccaab/family1 2023-10-29 15:53:32,916 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testScannerOnBulkLoadRefHFiles__fbvtf7bko787ls28s0ethtcrstte346j2943o3t43luhrqmfmkrr7c1mfftt98la/family1/93a7ab8d9514446b987dbbed24959827 into 3a1649507b121e0e15742780ce4ccaab/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_) 2023-10-29 15:53:32,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testScannerOnBulkLoadRefHFiles__fbvtf7bko787ls28s0ethtcrstte346j2943o3t43luhrqmfmkrr7c1mfftt98la/family1/93a7ab8d9514446b987dbbed24959827 2023-10-29 15:53:32,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 15:53:32,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 15:53:32,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): 3a1649507b121e0e15742780ce4ccaab/family1 is initiating minor compaction (all files) 2023-10-29 15:53:32,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@458fc8e2; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:32,917 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 3a1649507b121e0e15742780ce4ccaab/family1 in testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:53:32,918 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/8c974acbea3a4bcb9955d39be15a0566, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/394112e80bb9421aa6d943e96f0b1d4b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/.tmp, totalSize=15.1 K 2023-10-29 15:53:32,918 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 8c974acbea3a4bcb9955d39be15a0566, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594810003 2023-10-29 15:53:32,918 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 394112e80bb9421aa6d943e96f0b1d4b, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594810003 2023-10-29 15:53:32,919 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594810003 2023-10-29 15:53:32,919 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 15:53:32,920 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:32,922 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029b9abcd0c35bb4244a681de825d56b345 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029b9abcd0c35bb4244a681de825d56b345 2023-10-29 15:53:32,924 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029c95ac91614e040259c16b96859058cd9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231029c95ac91614e040259c16b96859058cd9 2023-10-29 15:53:32,924 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-10-29 15:53:32,924 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 15:53:32,924 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-10-29 15:53:32,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-10-29 15:53:32,925 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:32,925 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-10-29 15:53:32,927 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 913 msec 2023-10-29 15:53:32,934 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] throttle.PressureAwareThroughputController(145): 3a1649507b121e0e15742780ce4ccaab#family1#compaction#37 average throughput is 0.03 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:32,962 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260 (was 259) - Thread LEAK? -, OpenFileDescriptor=614 (was 620), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 267), ProcessCount=168 (was 168), AvailableMemoryMB=3171 (was 3206) 2023-10-29 15:53:32,972 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=260, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=168, AvailableMemoryMB=3170 2023-10-29 15:53:32,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 15:53:32,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:32,976 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:53:32,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-10-29 15:53:32,977 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:53:32,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 15:53:32,978 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:32,979 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628 empty. 2023-10-29 15:53:32,979 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:32,979 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-10-29 15:53:33,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 15:53:33,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 15:53:33,390 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 15:53:33,392 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => f85d6ae07911193766c8d5830d329628, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:53:33,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:33,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing f85d6ae07911193766c8d5830d329628, disabling compactions & flushes 2023-10-29 15:53:33,404 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:33,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:33,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. after waiting 0 ms 2023-10-29 15:53:33,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:33,404 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:33,404 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:33,407 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:53:33,409 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698594813409"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594813409"}]},"ts":"1698594813409"} 2023-10-29 15:53:33,410 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:53:33,411 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:53:33,412 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594813412"}]},"ts":"1698594813412"} 2023-10-29 15:53:33,413 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-10-29 15:53:33,416 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f85d6ae07911193766c8d5830d329628, ASSIGN}] 2023-10-29 15:53:33,418 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f85d6ae07911193766c8d5830d329628, ASSIGN 2023-10-29 15:53:33,419 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f85d6ae07911193766c8d5830d329628, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:53:33,570 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f85d6ae07911193766c8d5830d329628, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:33,570 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698594813570"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594813570"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594813570"}]},"ts":"1698594813570"} 2023-10-29 15:53:33,572 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure f85d6ae07911193766c8d5830d329628, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:33,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 15:53:33,724 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:33,727 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:33,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f85d6ae07911193766c8d5830d329628, NAME => 'testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:53:33,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:33,727 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:33,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:33,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:33,729 INFO [StoreOpener-f85d6ae07911193766c8d5830d329628-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:33,730 DEBUG [StoreOpener-f85d6ae07911193766c8d5830d329628-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1 2023-10-29 15:53:33,730 DEBUG [StoreOpener-f85d6ae07911193766c8d5830d329628-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1 2023-10-29 15:53:33,731 INFO [StoreOpener-f85d6ae07911193766c8d5830d329628-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f85d6ae07911193766c8d5830d329628 columnFamilyName family1 2023-10-29 15:53:33,732 INFO [StoreOpener-f85d6ae07911193766c8d5830d329628-1] regionserver.HStore(310): Store=f85d6ae07911193766c8d5830d329628/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:33,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:33,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:33,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for f85d6ae07911193766c8d5830d329628 2023-10-29 15:53:33,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:53:33,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened f85d6ae07911193766c8d5830d329628; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68995491, jitterRate=0.028112933039665222}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:53:33,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:33,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628., pid=37, masterSystemTime=1698594813724 2023-10-29 15:53:33,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:33,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:33,743 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=f85d6ae07911193766c8d5830d329628, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:33,743 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1698594813743"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594813743"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594813743"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594813743"}]},"ts":"1698594813743"} 2023-10-29 15:53:33,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=37, resume processing ppid=36 2023-10-29 15:53:33,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure f85d6ae07911193766c8d5830d329628, server=jenkins-hbase20.apache.org,44603,1698594767651 in 172 msec 2023-10-29 15:53:33,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=36, resume processing ppid=35 2023-10-29 15:53:33,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=f85d6ae07911193766c8d5830d329628, ASSIGN in 330 msec 2023-10-29 15:53:33,748 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:53:33,748 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594813748"}]},"ts":"1698594813748"} 2023-10-29 15:53:33,749 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-10-29 15:53:33,751 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:53:33,753 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 777 msec 2023-10-29 15:53:34,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-10-29 15:53:34,084 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-10-29 15:53:34,104 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:53:34,104 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x442f1cd3 to 127.0.0.1:62629 2023-10-29 15:53:34,104 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:53:34,105 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:53:34,107 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6370cf0a to 127.0.0.1:62629 2023-10-29 15:53:34,107 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:53:34,108 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:53:34,108 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07be110c to 127.0.0.1:62629 2023-10-29 15:53:34,108 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:53:34,109 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:53:34,109 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65cf5318 to 127.0.0.1:62629 2023-10-29 15:53:34,109 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:53:34,109 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:53:34,109 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03f0da01 to 127.0.0.1:62629 2023-10-29 15:53:34,109 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:53:34,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:34,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,127 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:34,127 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:34,127 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:34,127 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:34,163 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/.tmp/family1/65b9b819d48a4114abf2bd13dfb5667a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/65b9b819d48a4114abf2bd13dfb5667a 2023-10-29 15:53:34,171 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 3a1649507b121e0e15742780ce4ccaab/family1 of 3a1649507b121e0e15742780ce4ccaab into 65b9b819d48a4114abf2bd13dfb5667a(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:53:34,171 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 3a1649507b121e0e15742780ce4ccaab: 2023-10-29 15:53:34,171 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1698594812917; duration=1sec 2023-10-29 15:53:34,172 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:34,190 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/8c974acbea3a4bcb9955d39be15a0566, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/394112e80bb9421aa6d943e96f0b1d4b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_] to archive 2023-10-29 15:53:34,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:34,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/8c974acbea3a4bcb9955d39be15a0566 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/8c974acbea3a4bcb9955d39be15a0566 2023-10-29 15:53:34,196 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/394112e80bb9421aa6d943e96f0b1d4b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/394112e80bb9421aa6d943e96f0b1d4b 2023-10-29 15:53:34,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/family1/d6571de89e0c4d30927b1acd9dffdc50_SeqId_12_ 2023-10-29 15:53:34,212 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,212 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,214 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:34,214 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,214 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:34,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:34,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,215 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:34,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,216 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:34,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,217 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,217 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:34,218 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:34,218 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:34,218 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:34,219 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 15:53:34,242 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511305ab183865c98434fab202ac39b1953c3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305ab183865c98434fab202ac39b1953c3 2023-10-29 15:53:34,617 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:53:34,646 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/8e9e4435a2464628bb315948d6008eb7 2023-10-29 15:53:34,650 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/8e9e4435a2464628bb315948d6008eb7 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/8e9e4435a2464628bb315948d6008eb7 2023-10-29 15:53:34,655 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/8e9e4435a2464628bb315948d6008eb7, entries=1000, sequenceid=5, filesize=165.1 K 2023-10-29 15:53:34,655 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 436ms, sequenceid=5, compaction requested=false 2023-10-29 15:53:34,656 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:34,656 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:34,656 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:34,656 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:34,656 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:34,656 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,656 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:34,656 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:34,657 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,657 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:34,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:34,658 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,658 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:34,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:34,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:34,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:34,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:34,659 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47db67f0[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:34,659 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:34,659 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,660 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:34,660 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:34,660 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:34,660 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,660 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:34,660 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:34,660 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,660 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:34,660 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:34,663 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:34,663 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:34,663 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:34,663 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:34,663 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,663 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:34,664 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,664 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:34,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,664 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:34,664 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,664 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,665 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:34,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,666 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,666 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,666 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:34,666 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:34,667 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:34,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:34,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:34,667 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:34,667 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:34,667 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:34,667 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:34,667 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:34,667 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:34,667 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:34,667 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,667 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,667 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,767 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:34,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:34,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:34,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:34,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,782 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:34,782 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:34,782 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:34,782 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:34,783 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,784 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,785 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,785 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:34,785 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:34,786 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:34,786 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:34,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,787 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:34,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,788 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,789 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:34,789 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:34,789 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:34,789 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:34,789 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:34,789 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:34,790 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:34,790 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:34,790 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:34,790 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 15:53:35,216 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112876c368663dcb49c5b8d5946d798772ee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015112876c368663dcb49c5b8d5946d798772ee 2023-10-29 15:53:35,626 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/b47b2129d39847dcb5eb6728624d8afa 2023-10-29 15:53:35,635 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/b47b2129d39847dcb5eb6728624d8afa as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/b47b2129d39847dcb5eb6728624d8afa 2023-10-29 15:53:35,644 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/b47b2129d39847dcb5eb6728624d8afa, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 15:53:35,645 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 855ms, sequenceid=9, compaction requested=false 2023-10-29 15:53:35,645 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:35,645 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:35,646 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:35,646 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:35,646 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,646 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:35,646 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:35,649 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,649 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:35,650 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,650 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:35,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:35,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:35,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:35,653 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3af70169[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:35,653 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:35,653 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,654 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,654 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:35,654 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:35,654 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,654 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:35,654 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:35,655 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:35,655 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,655 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:35,655 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:35,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:35,657 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:35,657 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:35,657 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:35,657 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:35,658 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,658 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:35,658 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:35,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:35,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:35,659 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,660 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:35,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:35,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:35,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:35,662 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,662 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:35,662 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:35,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:35,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:35,762 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:35,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:35,772 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:35,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:35,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,773 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:35,773 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:35,773 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:35,773 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:35,774 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,774 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,774 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:35,774 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:35,775 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:35,775 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:35,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,775 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:35,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,776 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,776 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:35,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:35,776 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:35,776 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:35,776 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:35,777 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:35,777 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:35,777 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:35,777 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:35,777 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:36,202 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512011fdb4407d29c43208cc0aa3d965bed68 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011fdb4407d29c43208cc0aa3d965bed68 2023-10-29 15:53:36,610 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/5ab70db767a9400ba93d6ca51e59db03 2023-10-29 15:53:36,623 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/5ab70db767a9400ba93d6ca51e59db03 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/5ab70db767a9400ba93d6ca51e59db03 2023-10-29 15:53:36,630 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/5ab70db767a9400ba93d6ca51e59db03, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 15:53:36,632 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 855ms, sequenceid=13, compaction requested=true 2023-10-29 15:53:36,632 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:36,632 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:36,632 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:36,632 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:36,632 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,632 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:36,632 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:36,633 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,633 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:36,634 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,634 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:36,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:36,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:36,636 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e671ae8[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:36,636 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:36,636 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,636 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,637 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:36,637 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:36,637 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,637 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:36,637 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:36,638 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,638 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:36,638 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:36,638 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:36,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:36,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:36,640 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:36,640 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:36,640 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:36,640 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,640 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:36,641 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,641 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:36,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,641 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:36,641 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:36,641 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,642 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:36,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,643 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,643 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,643 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:36,643 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:36,644 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:36,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:36,644 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:36,644 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,644 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:36,644 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:36,644 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,644 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:36,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:36,644 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:36,644 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,744 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:36,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:36,750 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:36,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:36,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,752 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:36,752 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:36,752 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:36,752 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:36,752 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,752 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,753 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,753 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:36,753 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:36,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:36,753 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:36,753 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:36,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,754 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,754 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:36,754 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:36,754 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:36,754 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:36,754 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:36,755 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:36,755 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:36,755 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:36,755 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:36,755 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:37,178 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512057ab2060b3b0b4afcb3989bd480028882 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512057ab2060b3b0b4afcb3989bd480028882 2023-10-29 15:53:37,588 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/9640e729bdbb4c99a7b943fe338b571b 2023-10-29 15:53:37,597 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/9640e729bdbb4c99a7b943fe338b571b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/9640e729bdbb4c99a7b943fe338b571b 2023-10-29 15:53:37,602 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/9640e729bdbb4c99a7b943fe338b571b, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 15:53:37,603 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 848ms, sequenceid=17, compaction requested=true 2023-10-29 15:53:37,603 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:37,603 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:37,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:37,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:37,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:37,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:37,605 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,605 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:37,605 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,605 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:37,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:37,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:37,607 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23bd3a82[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:37,607 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:37,607 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,607 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,608 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:37,608 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:37,608 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:37,608 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,608 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:37,609 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,609 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:37,609 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:37,609 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:37,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:37,611 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:37,611 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:37,611 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:37,611 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:37,611 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,611 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:37,612 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:37,612 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,612 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:37,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:37,612 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,613 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,614 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,614 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,614 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:37,614 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,614 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:37,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:37,614 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:37,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:37,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:37,614 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,615 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:37,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:37,614 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:37,615 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:37,615 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,615 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:37,615 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,615 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,715 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:37,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:37,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:37,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:37,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,728 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:37,728 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:37,728 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:37,728 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:37,729 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,729 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,731 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,731 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:37,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:37,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:37,732 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:37,732 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:37,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:37,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,733 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,733 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:37,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:37,733 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:37,733 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:37,733 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:37,734 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:37,734 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:37,734 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:37,734 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:37,734 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:38,165 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286bc593108be64770a6ddaeb4bef6568c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512286bc593108be64770a6ddaeb4bef6568c 2023-10-29 15:53:38,576 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/fda3a1c8b52846b4888f14ee8623b84a 2023-10-29 15:53:38,588 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/fda3a1c8b52846b4888f14ee8623b84a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/fda3a1c8b52846b4888f14ee8623b84a 2023-10-29 15:53:38,595 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/fda3a1c8b52846b4888f14ee8623b84a, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 15:53:38,597 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 863ms, sequenceid=21, compaction requested=true 2023-10-29 15:53:38,597 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:38,597 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:38,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:38,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:38,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:38,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:38,599 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,599 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:38,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:38,599 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,599 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:38,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:38,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:38,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3f453de2[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:38,602 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:38,602 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,603 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,603 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:38,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:38,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:38,604 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,604 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:38,605 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,605 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:38,605 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:38,605 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:38,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:38,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:38,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:38,610 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:38,610 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:38,610 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:38,610 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:38,610 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,610 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:38,621 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,621 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:38,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,622 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:38,622 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:38,622 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,623 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,624 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,624 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,624 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:38,624 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:38,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:38,624 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:38,624 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:38,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:38,624 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:38,624 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,625 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,625 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,625 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:38,625 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,625 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:38,625 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:38,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:38,725 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:38,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:38,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:38,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:38,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,740 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:38,740 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:38,740 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:38,740 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:38,741 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,741 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,743 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:38,743 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:38,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:38,744 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:38,744 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:38,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:38,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,747 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,747 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:38,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:38,747 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:38,747 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:38,748 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:38,748 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:38,748 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:38,748 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:38,748 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:38,748 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:39,174 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512311358f2a743d64c1296a9c81ef28652cc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311358f2a743d64c1296a9c81ef28652cc 2023-10-29 15:53:39,581 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/91ab434b16b04ba4ba1e1d72350cb92b 2023-10-29 15:53:39,591 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/91ab434b16b04ba4ba1e1d72350cb92b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/91ab434b16b04ba4ba1e1d72350cb92b 2023-10-29 15:53:39,596 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/91ab434b16b04ba4ba1e1d72350cb92b, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 15:53:39,597 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 849ms, sequenceid=25, compaction requested=true 2023-10-29 15:53:39,597 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:39,597 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:39,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:39,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:39,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:39,597 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:39,708 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,708 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:39,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:39,710 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,710 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:39,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:39,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:39,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:39,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:39,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3dbb8f2a[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:39,715 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:39,716 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,722 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,722 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:39,722 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:39,722 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:39,723 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,723 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:39,725 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:39,725 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:39,725 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,725 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:39,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:39,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:39,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:39,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:39,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:39,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:39,733 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:39,733 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:39,733 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:39,733 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,733 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:39,738 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,738 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,738 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:39,738 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:39,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:39,739 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:39,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,740 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:39,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,744 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,745 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:39,744 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:39,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:39,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:39,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:39,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:39,745 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:39,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:39,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:39,845 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:39,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:39,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:39,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:39,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,854 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:39,854 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:39,854 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:39,854 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:39,854 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,854 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,856 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,856 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:39,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:39,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:39,856 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:39,856 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:39,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:39,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,858 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,858 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:39,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:39,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:39,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:39,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:39,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:39,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:39,858 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:39,858 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:39,859 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:40,283 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e3a33b92f64d43e0b0927612edc251b3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101e3a33b92f64d43e0b0927612edc251b3 2023-10-29 15:53:40,694 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/48800e72f59d42e7b55a7fcc61fc1b44 2023-10-29 15:53:40,707 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/48800e72f59d42e7b55a7fcc61fc1b44 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/48800e72f59d42e7b55a7fcc61fc1b44 2023-10-29 15:53:40,715 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/48800e72f59d42e7b55a7fcc61fc1b44, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 15:53:40,716 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 857ms, sequenceid=29, compaction requested=true 2023-10-29 15:53:40,716 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:40,716 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:40,717 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:40,717 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:40,717 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,717 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:40,717 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:40,718 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,718 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:40,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:40,719 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,719 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:40,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:40,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:40,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:40,721 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7bcd622f[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:40,721 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:40,722 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,723 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,723 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:40,723 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:40,723 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:40,723 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,724 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:40,725 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,725 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:40,725 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:40,725 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:40,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:40,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:40,730 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:40,730 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:40,731 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:40,731 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:40,731 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,731 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:40,733 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,733 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:40,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,733 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:40,734 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:40,734 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,736 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:40,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,741 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,741 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,741 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:40,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:40,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:40,741 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:40,741 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:40,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:40,741 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:40,741 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:40,741 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,742 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:40,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:40,742 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,742 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,742 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:40,842 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:40,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:40,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:40,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:40,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,855 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:40,855 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:40,855 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:40,855 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:40,855 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,855 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,856 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,856 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:40,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:40,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:40,856 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:40,857 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:40,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,857 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:40,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,857 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,858 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:40,858 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:40,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:40,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:40,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:40,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:40,858 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:40,858 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:40,858 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:40,858 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:41,281 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ac87df2cb6b64fdd8c7a6fb6ecdfa79b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ac87df2cb6b64fdd8c7a6fb6ecdfa79b 2023-10-29 15:53:41,690 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/a8f98b4dee5c46ca8cb4d849ee594826 2023-10-29 15:53:41,703 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/a8f98b4dee5c46ca8cb4d849ee594826 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/a8f98b4dee5c46ca8cb4d849ee594826 2023-10-29 15:53:41,708 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/a8f98b4dee5c46ca8cb4d849ee594826, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 15:53:41,708 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 850ms, sequenceid=33, compaction requested=true 2023-10-29 15:53:41,709 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:41,709 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:41,709 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:41,709 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:41,709 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,709 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:41,709 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:41,710 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,710 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:41,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:41,710 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,710 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:41,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:41,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:41,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:41,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:41,712 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@316e3efe[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:41,712 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:41,713 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,713 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,714 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:41,714 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:41,714 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:41,714 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,714 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:41,715 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:41,715 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,715 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:41,715 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:41,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:41,718 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:41,718 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:41,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:41,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:41,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,718 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:41,719 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,719 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:41,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:41,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,719 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:41,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:41,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:41,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:41,720 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:41,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,721 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:41,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,723 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,724 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,724 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:41,724 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:41,724 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:41,724 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:41,724 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:41,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:41,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:41,724 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:41,724 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,724 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,724 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,725 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,725 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:41,725 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:41,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:41,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:41,826 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:41,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:41,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:41,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:41,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,837 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:41,837 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:41,837 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:41,837 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:41,838 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,838 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,840 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,840 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:41,840 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:41,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:41,840 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:41,840 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:41,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:41,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,842 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,842 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:41,842 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:41,842 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:41,843 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:41,843 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:41,843 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:41,843 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:41,843 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:41,843 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:41,843 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:42,267 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509076282c0df73324f1887377cd8df3b17a6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201509076282c0df73324f1887377cd8df3b17a6 2023-10-29 15:53:42,674 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/2599747ba2324244b9a031487c09b31e 2023-10-29 15:53:42,687 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/2599747ba2324244b9a031487c09b31e as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/2599747ba2324244b9a031487c09b31e 2023-10-29 15:53:42,693 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/2599747ba2324244b9a031487c09b31e, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 15:53:42,694 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 851ms, sequenceid=37, compaction requested=true 2023-10-29 15:53:42,694 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:42,694 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:42,694 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:42,694 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:42,694 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,694 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:42,694 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:42,695 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,695 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:42,696 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,696 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:42,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:42,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@27d2bf1c[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:42,697 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:42,697 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,698 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,698 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:42,698 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:42,698 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:42,698 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,698 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:42,699 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,699 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:42,699 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:42,699 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:42,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:42,702 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:42,702 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:42,702 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:42,702 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:42,702 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,702 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:42,703 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,703 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,703 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:42,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:42,703 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,704 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:42,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:42,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:42,705 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,705 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:42,706 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:42,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:42,806 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:42,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:42,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:42,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:42,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,819 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:42,819 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:42,820 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-10-29 15:53:42,820 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-10-29 15:53:42,820 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,820 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,822 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,822 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:42,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:42,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:42,822 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:42,822 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:42,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:42,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,824 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,824 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-10-29 15:53:42,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:42,824 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-10-29 15:53:42,825 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:42,825 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-10-29 15:53:42,825 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:42,825 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:42,825 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:42,825 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. started... 2023-10-29 15:53:42,825 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing f85d6ae07911193766c8d5830d329628 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:43,243 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511200b9a3f71c0f84ed09454a69517b0b351 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511200b9a3f71c0f84ed09454a69517b0b351 2023-10-29 15:53:43,654 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/87d7e1af8ada49118e36e2255dc6be8f 2023-10-29 15:53:43,660 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/87d7e1af8ada49118e36e2255dc6be8f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/87d7e1af8ada49118e36e2255dc6be8f 2023-10-29 15:53:43,665 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/87d7e1af8ada49118e36e2255dc6be8f, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 15:53:43,666 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for f85d6ae07911193766c8d5830d329628 in 841ms, sequenceid=41, compaction requested=true 2023-10-29 15:53:43,666 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:43,667 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:43,667 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:43,667 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:43,667 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,667 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-10-29 15:53:43,667 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-10-29 15:53:43,668 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,668 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:43,668 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,668 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:43,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:43,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-10-29 15:53:43,670 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-10-29 15:53:43,670 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@46f1a613[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:43,670 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,671 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-10-29 15:53:43,671 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-10-29 15:53:43,671 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:43,671 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,671 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:43,671 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,671 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-10-29 15:53:43,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:43,671 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:43,672 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-10-29 15:53:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:43,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:53:43,674 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-10-29 15:53:43,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:43,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:43,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,674 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:43,675 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,675 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,675 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:43,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:43,675 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:43,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,676 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:43,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,681 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,681 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:43,681 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:43,681 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:43,681 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:43,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-10-29 15:53:43,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:43,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:43,681 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,682 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:43,682 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,682 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,682 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,682 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:43,682 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:43,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:43,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:43,782 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:43,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:43,784 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-10-29 15:53:43,786 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:43,786 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:43,787 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:43,787 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595423787 2023-10-29 15:53:43,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:53:43,790 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-10-29 15:53:43,791 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:43,792 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x429dbdcc to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:53:43,796 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37220720, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:53:43,796 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,639 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103d51f5c0dd14e49288bd5d079bb498e11 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103d51f5c0dd14e49288bd5d079bb498e11 2023-10-29 15:53:44,640 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:44,651 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:53:44,652 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:53:44,658 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:53:44,659 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:53:44,671 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/62593c460c5d448496e5d8c3bcab38d1 first=Optional[r3] last=Optional[r6] 2023-10-29 15:53:44,672 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/62593c460c5d448496e5d8c3bcab38d1}] 2023-10-29 15:53:44,677 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/62593c460c5d448496e5d8c3bcab38d1 for inclusion in f85d6ae07911193766c8d5830d329628/family1 2023-10-29 15:53:44,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 15:53:44,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:44,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:44,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/62593c460c5d448496e5d8c3bcab38d1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kauc6rv011ufc540rdjqen6cn5a9fv5l1v1q5qch15lqrg2s64hpqbap5eash3c/family1/62593c460c5d448496e5d8c3bcab38d1 2023-10-29 15:53:44,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kauc6rv011ufc540rdjqen6cn5a9fv5l1v1q5qch15lqrg2s64hpqbap5eash3c/family1/62593c460c5d448496e5d8c3bcab38d1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/0faa173456054720b9a0e1c8e1b17e75_SeqId_44_ 2023-10-29 15:53:44,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kauc6rv011ufc540rdjqen6cn5a9fv5l1v1q5qch15lqrg2s64hpqbap5eash3c/family1/62593c460c5d448496e5d8c3bcab38d1 into f85d6ae07911193766c8d5830d329628/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/0faa173456054720b9a0e1c8e1b17e75_SeqId_44_ - updating store file list. 2023-10-29 15:53:44,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/0faa173456054720b9a0e1c8e1b17e75_SeqId_44_ into f85d6ae07911193766c8d5830d329628/family1 2023-10-29 15:53:44,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kauc6rv011ufc540rdjqen6cn5a9fv5l1v1q5qch15lqrg2s64hpqbap5eash3c/family1/62593c460c5d448496e5d8c3bcab38d1 into f85d6ae07911193766c8d5830d329628/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/0faa173456054720b9a0e1c8e1b17e75_SeqId_44_) 2023-10-29 15:53:44,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__kauc6rv011ufc540rdjqen6cn5a9fv5l1v1q5qch15lqrg2s64hpqbap5eash3c/family1/62593c460c5d448496e5d8c3bcab38d1 2023-10-29 15:53:44,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 15:53:44,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 15:53:44,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): f85d6ae07911193766c8d5830d329628/family1 is initiating minor compaction 2023-10-29 15:53:44,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1a2e1ead; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:44,691 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of f85d6ae07911193766c8d5830d329628/family1 in testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:53:44,691 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/b47b2129d39847dcb5eb6728624d8afa, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/5ab70db767a9400ba93d6ca51e59db03, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/9640e729bdbb4c99a7b943fe338b571b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/fda3a1c8b52846b4888f14ee8623b84a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/91ab434b16b04ba4ba1e1d72350cb92b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/48800e72f59d42e7b55a7fcc61fc1b44, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/a8f98b4dee5c46ca8cb4d849ee594826, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/2599747ba2324244b9a031487c09b31e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/87d7e1af8ada49118e36e2255dc6be8f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/0faa173456054720b9a0e1c8e1b17e75_SeqId_44_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp, totalSize=50.0 K 2023-10-29 15:53:44,691 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting b47b2129d39847dcb5eb6728624d8afa, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 15:53:44,691 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 5ab70db767a9400ba93d6ca51e59db03, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 15:53:44,691 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 9640e729bdbb4c99a7b943fe338b571b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 15:53:44,692 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting fda3a1c8b52846b4888f14ee8623b84a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 15:53:44,692 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 91ab434b16b04ba4ba1e1d72350cb92b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 15:53:44,692 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 48800e72f59d42e7b55a7fcc61fc1b44, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 15:53:44,692 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting a8f98b4dee5c46ca8cb4d849ee594826, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 15:53:44,692 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 2599747ba2324244b9a031487c09b31e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 15:53:44,692 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 87d7e1af8ada49118e36e2255dc6be8f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 15:53:44,692 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 0faa173456054720b9a0e1c8e1b17e75_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 15:53:44,693 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:44,694 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:44,695 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512286bc593108be64770a6ddaeb4bef6568c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512286bc593108be64770a6ddaeb4bef6568c 2023-10-29 15:53:44,696 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311358f2a743d64c1296a9c81ef28652cc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512311358f2a743d64c1296a9c81ef28652cc 2023-10-29 15:53:44,697 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101e3a33b92f64d43e0b0927612edc251b3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101e3a33b92f64d43e0b0927612edc251b3 2023-10-29 15:53:44,698 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ac87df2cb6b64fdd8c7a6fb6ecdfa79b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103ac87df2cb6b64fdd8c7a6fb6ecdfa79b 2023-10-29 15:53:44,698 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-10-29 15:53:44,698 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 15:53:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,699 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,779 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): f85d6ae07911193766c8d5830d329628#family1#compaction#48 average throughput is 0.07 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:44,833 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053531e01cce7943e7a51ea34b33cce009 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053531e01cce7943e7a51ea34b33cce009 2023-10-29 15:53:44,835 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:44,859 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/71d06e37d51944bca052180abe90af10 first=Optional[r00] last=Optional[r2] 2023-10-29 15:53:44,860 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/71d06e37d51944bca052180abe90af10}] 2023-10-29 15:53:44,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/71d06e37d51944bca052180abe90af10 for inclusion in f85d6ae07911193766c8d5830d329628/family1 2023-10-29 15:53:44,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 15:53:44,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:44,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:44,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/71d06e37d51944bca052180abe90af10 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cfvltdo0mp635kqo9cc9og0i5q2o0u7jqkuegr5eecu8mpng229po5arglgunkk3/family1/71d06e37d51944bca052180abe90af10 2023-10-29 15:53:44,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cfvltdo0mp635kqo9cc9og0i5q2o0u7jqkuegr5eecu8mpng229po5arglgunkk3/family1/71d06e37d51944bca052180abe90af10 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/7085653d46424307afb2f653e994c614_SeqId_46_ 2023-10-29 15:53:44,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cfvltdo0mp635kqo9cc9og0i5q2o0u7jqkuegr5eecu8mpng229po5arglgunkk3/family1/71d06e37d51944bca052180abe90af10 into f85d6ae07911193766c8d5830d329628/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/7085653d46424307afb2f653e994c614_SeqId_46_ - updating store file list. 2023-10-29 15:53:44,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/7085653d46424307afb2f653e994c614_SeqId_46_ into f85d6ae07911193766c8d5830d329628/family1 2023-10-29 15:53:44,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cfvltdo0mp635kqo9cc9og0i5q2o0u7jqkuegr5eecu8mpng229po5arglgunkk3/family1/71d06e37d51944bca052180abe90af10 into f85d6ae07911193766c8d5830d329628/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/7085653d46424307afb2f653e994c614_SeqId_46_) 2023-10-29 15:53:44,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyPolicy__cfvltdo0mp635kqo9cc9og0i5q2o0u7jqkuegr5eecu8mpng229po5arglgunkk3/family1/71d06e37d51944bca052180abe90af10 2023-10-29 15:53:44,878 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:44,879 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:44,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305ab183865c98434fab202ac39b1953c3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201511305ab183865c98434fab202ac39b1953c3 2023-10-29 15:53:44,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011fdb4407d29c43208cc0aa3d965bed68 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512011fdb4407d29c43208cc0aa3d965bed68 2023-10-29 15:53:44,883 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512057ab2060b3b0b4afcb3989bd480028882 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512057ab2060b3b0b4afcb3989bd480028882 2023-10-29 15:53:44,883 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-10-29 15:53:44,883 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 15:53:44,884 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-10-29 15:53:44,884 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-10-29 15:53:44,884 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:44,885 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:53:44,887 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.1000 sec 2023-10-29 15:53:45,022 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=256 (was 260), OpenFileDescriptor=616 (was 614) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 246) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3070 (was 3170) 2023-10-29 15:53:45,035 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=256, OpenFileDescriptor=616, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=168, AvailableMemoryMB=3070 2023-10-29 15:53:45,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 15:53:45,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:45,040 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:53:45,040 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-10-29 15:53:45,041 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:53:45,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 15:53:45,046 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:45,047 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca empty. 2023-10-29 15:53:45,047 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:45,047 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-10-29 15:53:45,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 15:53:45,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 15:53:45,481 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-29 15:53:45,482 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => bd7ee8dbf5c23af94dc862ed86a91dca, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:53:45,608 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/.tmp/family1/58266d4648df4500ab2c7558aaac5510 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/58266d4648df4500ab2c7558aaac5510 2023-10-29 15:53:45,613 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in f85d6ae07911193766c8d5830d329628/family1 of f85d6ae07911193766c8d5830d329628 into 58266d4648df4500ab2c7558aaac5510(size=6.6 K), total size for store is 337.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:53:45,613 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:53:45,614 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1698594824691; duration=0sec 2023-10-29 15:53:45,614 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:45,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 15:53:45,694 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/b47b2129d39847dcb5eb6728624d8afa, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/5ab70db767a9400ba93d6ca51e59db03, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/9640e729bdbb4c99a7b943fe338b571b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/fda3a1c8b52846b4888f14ee8623b84a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/91ab434b16b04ba4ba1e1d72350cb92b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/48800e72f59d42e7b55a7fcc61fc1b44, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/a8f98b4dee5c46ca8cb4d849ee594826, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/2599747ba2324244b9a031487c09b31e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/87d7e1af8ada49118e36e2255dc6be8f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/0faa173456054720b9a0e1c8e1b17e75_SeqId_44_] to archive 2023-10-29 15:53:45,696 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:45,697 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/b47b2129d39847dcb5eb6728624d8afa to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/b47b2129d39847dcb5eb6728624d8afa 2023-10-29 15:53:45,698 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/5ab70db767a9400ba93d6ca51e59db03 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/5ab70db767a9400ba93d6ca51e59db03 2023-10-29 15:53:45,699 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/9640e729bdbb4c99a7b943fe338b571b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/9640e729bdbb4c99a7b943fe338b571b 2023-10-29 15:53:45,701 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/fda3a1c8b52846b4888f14ee8623b84a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/fda3a1c8b52846b4888f14ee8623b84a 2023-10-29 15:53:45,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/91ab434b16b04ba4ba1e1d72350cb92b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/91ab434b16b04ba4ba1e1d72350cb92b 2023-10-29 15:53:45,703 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/48800e72f59d42e7b55a7fcc61fc1b44 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/48800e72f59d42e7b55a7fcc61fc1b44 2023-10-29 15:53:45,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/a8f98b4dee5c46ca8cb4d849ee594826 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/a8f98b4dee5c46ca8cb4d849ee594826 2023-10-29 15:53:45,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/2599747ba2324244b9a031487c09b31e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/2599747ba2324244b9a031487c09b31e 2023-10-29 15:53:45,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/87d7e1af8ada49118e36e2255dc6be8f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/87d7e1af8ada49118e36e2255dc6be8f 2023-10-29 15:53:45,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/0faa173456054720b9a0e1c8e1b17e75_SeqId_44_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/family1/0faa173456054720b9a0e1c8e1b17e75_SeqId_44_ 2023-10-29 15:53:45,888 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:45,888 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing bd7ee8dbf5c23af94dc862ed86a91dca, disabling compactions & flushes 2023-10-29 15:53:45,888 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:45,888 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:45,888 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. after waiting 0 ms 2023-10-29 15:53:45,888 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:45,888 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:45,888 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:45,891 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:53:45,892 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594825892"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594825892"}]},"ts":"1698594825892"} 2023-10-29 15:53:45,893 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:53:45,894 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:53:45,894 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594825894"}]},"ts":"1698594825894"} 2023-10-29 15:53:45,895 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-10-29 15:53:45,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, ASSIGN}] 2023-10-29 15:53:45,950 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, ASSIGN 2023-10-29 15:53:45,951 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:53:46,102 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:46,102 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594826102"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594826102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594826102"}]},"ts":"1698594826102"} 2023-10-29 15:53:46,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:46,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 15:53:46,256 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:46,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:46,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd7ee8dbf5c23af94dc862ed86a91dca, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:53:46,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:46,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:46,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:46,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:46,260 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:46,262 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:53:46,262 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:53:46,262 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd7ee8dbf5c23af94dc862ed86a91dca columnFamilyName family1 2023-10-29 15:53:46,263 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(310): Store=bd7ee8dbf5c23af94dc862ed86a91dca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:46,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:46,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:46,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:46,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:53:46,270 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bd7ee8dbf5c23af94dc862ed86a91dca; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65525700, jitterRate=-0.02359098196029663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:53:46,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:46,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca., pid=41, masterSystemTime=1698594826256 2023-10-29 15:53:46,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:46,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:46,273 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:46,273 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594826273"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594826273"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594826273"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594826273"}]},"ts":"1698594826273"} 2023-10-29 15:53:46,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=41, resume processing ppid=40 2023-10-29 15:53:46,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651 in 170 msec 2023-10-29 15:53:46,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=39 2023-10-29 15:53:46,278 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, ASSIGN in 328 msec 2023-10-29 15:53:46,278 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:53:46,279 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594826278"}]},"ts":"1698594826278"} 2023-10-29 15:53:46,280 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-10-29 15:53:46,282 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:53:46,283 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.2440 sec 2023-10-29 15:53:47,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-10-29 15:53:47,148 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-10-29 15:53:47,171 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:47,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:47,176 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:47,176 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:47,176 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:47,176 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:47,176 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:47,176 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:47,177 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:47,177 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:47,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:47,177 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:47,177 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:47,177 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:47,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:47,178 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:47,178 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:47,178 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:47,179 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:47,179 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:47,179 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 15:53:47,613 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113097fb136bcf73452db8e533da7b3a7027 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113097fb136bcf73452db8e533da7b3a7027 2023-10-29 15:53:48,018 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/1041f3b08581405cb622ac7e57e0f349 2023-10-29 15:53:48,025 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/1041f3b08581405cb622ac7e57e0f349 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1041f3b08581405cb622ac7e57e0f349 2023-10-29 15:53:48,030 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1041f3b08581405cb622ac7e57e0f349, entries=1000, sequenceid=5, filesize=191.4 K 2023-10-29 15:53:48,031 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 852ms, sequenceid=5, compaction requested=false 2023-10-29 15:53:48,031 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:48,032 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:48,032 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:48,032 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:48,032 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:48,032 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,032 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:48,032 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:48,033 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:48,033 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:48,034 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,034 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:48,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:48,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:48,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:48,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:48,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@56bd78f8[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:48,035 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:48,035 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,036 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,036 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:48,036 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:48,036 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,036 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:48,036 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:48,037 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:48,037 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:48,037 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,037 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:48,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:48,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:48,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:48,039 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:48,039 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:48,039 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:48,039 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,039 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:48,040 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,040 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,040 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:48,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:48,041 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:48,041 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:48,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,041 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,043 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:48,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:48,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:48,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:48,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:48,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:48,043 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:48,044 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:48,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:48,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:48,144 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:48,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:48,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:48,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:48,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,152 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:48,152 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:48,152 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:48,152 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:48,152 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,152 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,153 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:48,153 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:48,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:48,153 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,153 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:48,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,154 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:48,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,154 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,154 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:48,154 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,154 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:48,154 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:48,155 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:48,155 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:48,155 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:48,155 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:48,155 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:48,155 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 15:53:48,572 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283c0f4712bf3349879920f99a68fd8764 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283c0f4712bf3349879920f99a68fd8764 2023-10-29 15:53:48,977 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/09ed51e0faf043e688b6208826eb9685 2023-10-29 15:53:48,982 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/09ed51e0faf043e688b6208826eb9685 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/09ed51e0faf043e688b6208826eb9685 2023-10-29 15:53:48,987 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/09ed51e0faf043e688b6208826eb9685, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 15:53:48,988 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 833ms, sequenceid=9, compaction requested=false 2023-10-29 15:53:48,988 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:48,989 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:48,989 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:48,990 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,990 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,990 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,991 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:48,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:48,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:48,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:48,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:48,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:48,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:48,992 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1664251f[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:48,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:48,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,993 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,993 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:48,993 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,993 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:48,994 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:48,994 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:48,995 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:48,995 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,995 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:48,995 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:48,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:48,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:48,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:48,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:48,997 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:48,997 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:48,997 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:48,997 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,997 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:48,998 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,998 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,998 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:48,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:48,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,999 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:48,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:48,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:49,000 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:49,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:49,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:49,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:49,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:49,003 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:49,002 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:49,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,003 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,003 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:49,003 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:49,003 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:49,003 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,003 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:49,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:49,003 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,103 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:49,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:49,108 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:49,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:49,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,110 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:49,110 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:49,110 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:49,110 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:49,111 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,111 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:49,112 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:49,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:49,112 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,113 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,113 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:49,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,113 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,114 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:49,114 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,114 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:49,114 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:49,114 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:49,114 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:49,114 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:49,114 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:49,114 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:49,114 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:49,130 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201fbebc45ecb214c87b432efd81d618ce1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201fbebc45ecb214c87b432efd81d618ce1 2023-10-29 15:53:49,536 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/e7eb9e4508b349c8aad668ba39048b57 2023-10-29 15:53:49,544 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/e7eb9e4508b349c8aad668ba39048b57 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/e7eb9e4508b349c8aad668ba39048b57 2023-10-29 15:53:49,550 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/e7eb9e4508b349c8aad668ba39048b57, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 15:53:49,551 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 437ms, sequenceid=13, compaction requested=true 2023-10-29 15:53:49,551 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:49,551 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:49,551 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:49,551 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:49,551 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,551 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:49,552 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:49,553 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,553 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:49,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:49,554 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:49,554 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:49,557 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:49,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:49,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:49,559 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@24fc5290[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:49,559 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:49,559 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,563 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,563 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:49,563 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:49,563 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:49,564 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,564 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:49,565 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,565 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:49,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:49,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:49,565 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:49,565 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:49,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:49,565 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:49,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:49,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:49,568 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:49,568 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:49,568 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:49,568 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:49,568 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,568 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:49,569 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,569 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:49,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:49,569 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,569 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:49,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:49,570 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:49,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:49,570 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:49,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,571 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:49,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:49,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:49,575 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:49,575 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:49,575 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,575 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:49,576 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:49,576 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:49,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:49,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:49,579 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:49,676 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:49,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:49,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:49,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:49,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,682 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:49,682 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:49,682 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:49,682 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:49,683 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,683 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,684 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:49,684 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,684 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:49,684 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:49,684 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:49,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,685 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:49,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,685 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,686 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:49,686 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:49,686 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:49,686 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:49,686 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:49,692 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:49,692 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:49,692 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:49,692 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:49,692 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:50,121 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205251eacddd3494559bd09d79f2eda2c0a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205251eacddd3494559bd09d79f2eda2c0a 2023-10-29 15:53:50,527 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/8133046a2b754040873195f9cb0601ac 2023-10-29 15:53:50,532 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/8133046a2b754040873195f9cb0601ac as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8133046a2b754040873195f9cb0601ac 2023-10-29 15:53:50,537 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8133046a2b754040873195f9cb0601ac, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 15:53:50,537 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 845ms, sequenceid=17, compaction requested=true 2023-10-29 15:53:50,537 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:50,537 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:50,537 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:50,538 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:50,538 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,538 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:50,538 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:50,539 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,539 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:50,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:50,539 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,539 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:50,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:50,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:50,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:50,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:50,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f76b922[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:50,541 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:50,541 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,541 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:50,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:50,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:50,542 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,542 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:50,543 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,543 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:50,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:50,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:50,543 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:50,543 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:50,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:50,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:50,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:50,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:50,545 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:50,545 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:50,546 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:50,546 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:50,546 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,546 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:50,547 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,547 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,547 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:50,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:50,547 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:50,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:50,547 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:50,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:50,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,549 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:50,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,551 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:50,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:50,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:50,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,651 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:50,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:50,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:50,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:50,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,662 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:50,662 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:50,663 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:50,663 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:50,663 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,663 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,665 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,665 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:50,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:50,665 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:50,665 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,666 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,666 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:50,666 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:50,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:50,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:50,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:50,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:50,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:50,667 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:50,667 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:50,667 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:51,079 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015122816d08e884ed848b385c6e330a9c7864e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122816d08e884ed848b385c6e330a9c7864e 2023-10-29 15:53:51,489 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/2b175515a81d4f88909833ab0514b125 2023-10-29 15:53:51,496 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/2b175515a81d4f88909833ab0514b125 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/2b175515a81d4f88909833ab0514b125 2023-10-29 15:53:51,501 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/2b175515a81d4f88909833ab0514b125, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 15:53:51,501 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 834ms, sequenceid=21, compaction requested=true 2023-10-29 15:53:51,502 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:51,502 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:51,502 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:51,502 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:51,502 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,502 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:51,502 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:51,503 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,503 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:51,503 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,503 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:51,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:51,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:51,504 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:51,504 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52b1668c[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:51,504 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,505 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,505 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,505 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:51,505 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:51,505 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:51,505 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,505 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:51,506 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,506 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:51,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:51,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:51,506 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:51,506 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:51,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:51,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:51,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:51,508 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:51,508 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:51,508 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:51,508 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:51,508 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,508 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:51,509 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,509 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,509 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:51,509 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:51,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,510 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:51,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,511 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,511 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:51,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:51,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:51,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,512 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:51,512 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:51,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,512 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:51,613 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:51,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:51,618 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:51,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:51,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,620 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:51,620 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:51,620 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:51,620 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:51,620 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,620 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,621 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:51,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:51,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:51,621 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,622 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:51,622 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:51,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,623 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,623 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:51,623 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:51,623 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:51,623 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:51,623 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:51,623 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:51,623 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:51,623 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:51,623 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:51,624 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:51,787 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:53:52,043 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d29a560932fe4c90a47b64063b02013d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231d29a560932fe4c90a47b64063b02013d 2023-10-29 15:53:52,450 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/25bf776311344bc6842c3f92adaf3985 2023-10-29 15:53:52,462 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/25bf776311344bc6842c3f92adaf3985 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/25bf776311344bc6842c3f92adaf3985 2023-10-29 15:53:52,470 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/25bf776311344bc6842c3f92adaf3985, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 15:53:52,472 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 848ms, sequenceid=25, compaction requested=true 2023-10-29 15:53:52,472 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:52,472 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:52,472 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:52,472 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:52,472 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,472 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:52,472 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:52,474 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,474 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:52,474 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,474 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:52,474 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:52,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:52,476 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@65cafd18[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:52,476 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:52,476 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,476 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,476 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,477 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:52,477 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:52,477 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:52,477 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,477 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:52,477 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:52,477 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:52,477 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,477 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:52,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,479 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:52,479 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:52,479 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:52,479 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:52,479 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:52,479 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,479 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:52,480 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,480 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:52,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:52,480 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,480 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:52,481 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,482 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:52,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:52,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:52,483 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:52,483 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,483 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:52,484 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:52,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:52,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:52,584 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:52,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:52,594 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:52,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:52,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,597 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:52,597 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:52,597 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:52,597 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:52,598 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,598 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,599 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:52,599 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:52,599 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:52,599 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:52,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,600 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:52,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,601 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,601 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:52,601 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:52,601 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:52,601 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:52,601 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:52,601 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:52,601 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:52,601 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:52,601 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:52,602 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:53,027 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601010eaee333f67e44ae95304e97586e63a8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601010eaee333f67e44ae95304e97586e63a8 2023-10-29 15:53:53,435 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/1896be5c75ff4f4e9ce72c923a0f1a70 2023-10-29 15:53:53,443 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/1896be5c75ff4f4e9ce72c923a0f1a70 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1896be5c75ff4f4e9ce72c923a0f1a70 2023-10-29 15:53:53,447 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1896be5c75ff4f4e9ce72c923a0f1a70, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 15:53:53,448 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 846ms, sequenceid=29, compaction requested=true 2023-10-29 15:53:53,448 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:53,448 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:53,448 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:53,448 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:53,449 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:53,450 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,450 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:53,450 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,450 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:53,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:53,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:53,451 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23e44be3[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:53,451 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:53,451 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,452 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,452 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:53,452 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:53,452 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:53,452 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,452 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:53,454 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:53,454 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:53,454 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,454 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:53,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:53,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:53,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:53,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:53,457 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:53,457 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:53,457 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:53,457 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,457 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:53,463 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,463 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:53,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,463 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:53,463 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,463 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:53,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,464 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,466 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:53,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:53,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:53,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:53,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:53,466 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:53,567 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:53,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:53,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:53,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:53,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,575 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:53,575 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:53,575 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:53,575 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:53,576 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,576 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,577 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:53,577 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,577 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:53,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:53,578 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:53,578 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:53,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,578 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:53,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,579 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,579 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:53,579 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:53,579 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:53,579 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:53,579 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:53,579 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:53,579 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:53,579 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:53,579 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:53,580 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:54,003 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103936d47065cab4c8eb9648bc9fd414eb8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103936d47065cab4c8eb9648bc9fd414eb8 2023-10-29 15:53:54,410 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/8dfffafa163e4d10891a66786105ba3f 2023-10-29 15:53:54,418 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/8dfffafa163e4d10891a66786105ba3f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8dfffafa163e4d10891a66786105ba3f 2023-10-29 15:53:54,425 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8dfffafa163e4d10891a66786105ba3f, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 15:53:54,426 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 847ms, sequenceid=33, compaction requested=true 2023-10-29 15:53:54,426 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:54,426 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:54,426 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:54,426 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:54,426 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,426 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:54,426 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:54,428 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,428 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:54,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:54,428 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,428 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:54,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:54,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:54,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:54,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:54,430 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@79015914[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:54,430 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:54,431 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,432 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,432 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,432 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:54,432 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:54,432 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:54,432 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:54,433 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,433 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:54,433 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:54,433 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:54,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:54,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:54,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:54,436 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:54,436 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:54,436 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:54,436 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,436 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:54,436 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,436 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:54,436 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,436 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:54,437 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,438 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,439 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:54,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:54,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:54,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,439 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:54,440 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:54,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:54,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:54,540 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:54,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:54,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:54,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:54,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,550 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:54,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:54,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:54,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:54,551 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,551 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,552 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:54,552 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:54,553 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:54,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,553 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:54,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:54,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,555 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,555 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:54,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:54,555 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:54,555 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:54,555 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:54,556 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:54,556 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:54,556 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:54,556 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:54,556 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:54,980 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078819952a0d4d4866bc9329cb0b3bfcb5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201509078819952a0d4d4866bc9329cb0b3bfcb5 2023-10-29 15:53:55,389 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/547980f01a8f4c44a5b1b6e778a7eab6 2023-10-29 15:53:55,403 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/547980f01a8f4c44a5b1b6e778a7eab6 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/547980f01a8f4c44a5b1b6e778a7eab6 2023-10-29 15:53:55,409 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/547980f01a8f4c44a5b1b6e778a7eab6, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 15:53:55,410 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 854ms, sequenceid=37, compaction requested=true 2023-10-29 15:53:55,411 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:55,411 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:55,411 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:55,411 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:55,411 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,411 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:55,411 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:55,413 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,413 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:55,413 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,413 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:55,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:55,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:55,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:55,416 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@205dd5be[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:55,416 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:55,416 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,417 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,417 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,417 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:55,417 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:55,417 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:55,417 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,417 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:55,418 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,419 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:55,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:55,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:55,419 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:55,419 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:55,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:55,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:55,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:55,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:55,422 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:55,422 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:55,423 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:55,423 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:55,423 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,423 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:55,429 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,430 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:55,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,429 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:55,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:55,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:55,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:55,431 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:55,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,432 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:55,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:55,439 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:55,439 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:55,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:55,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:55,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:55,439 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:55,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:55,439 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,440 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:55,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:55,440 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,440 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:55,440 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:55,440 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,441 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,541 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:55,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:55,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:53:55,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-10-29 15:53:55,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,557 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:55,557 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:55,557 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-10-29 15:53:55,557 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-10-29 15:53:55,558 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,558 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,559 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:55,559 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,559 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:55,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:55,559 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:55,560 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:53:55,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,560 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:53:55,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,561 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,561 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-10-29 15:53:55,561 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:55,561 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-10-29 15:53:55,561 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:53:55,561 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-10-29 15:53:55,562 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:53:55,562 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:53:55,562 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:55,562 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. started... 2023-10-29 15:53:55,562 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bd7ee8dbf5c23af94dc862ed86a91dca 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:53:55,987 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ac8c2bb597244771b1d9ff1562b34ee5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ac8c2bb597244771b1d9ff1562b34ee5 2023-10-29 15:53:56,394 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/da60de0cbfbe48038074263c2309b97b 2023-10-29 15:53:56,399 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/da60de0cbfbe48038074263c2309b97b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/da60de0cbfbe48038074263c2309b97b 2023-10-29 15:53:56,403 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/da60de0cbfbe48038074263c2309b97b, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 15:53:56,404 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for bd7ee8dbf5c23af94dc862ed86a91dca in 842ms, sequenceid=41, compaction requested=true 2023-10-29 15:53:56,404 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:56,404 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:56,404 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:53:56,404 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:53:56,404 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,404 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-10-29 15:53:56,404 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-10-29 15:53:56,405 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,405 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:56,406 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,406 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:53:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:56,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:56,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-10-29 15:53:56,407 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@124dde90[Count = 0] remaining members to acquire global barrier 2023-10-29 15:53:56,407 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-10-29 15:53:56,407 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,408 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,408 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,408 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-10-29 15:53:56,408 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-10-29 15:53:56,408 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,408 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:53:56,408 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:53:56,409 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,409 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-10-29 15:53:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:56,409 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:56,409 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-10-29 15:53:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:56,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:53:56,411 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-10-29 15:53:56,411 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-10-29 15:53:56,411 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:53:56,411 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:53:56,411 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,411 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:53:56,411 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,411 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:53:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:53:56,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,412 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:53:56,412 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:53:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,413 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:53:56,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,415 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:53:56,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:56,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-10-29 15:53:56,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-10-29 15:53:56,415 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:53:56,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,417 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:53:56,417 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:53:56,418 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-10-29 15:53:56,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:53:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:53:56,418 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:53:56,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:53:56,515 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:53:56,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:53:56,518 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:56,519 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:56,520 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:56,520 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595436520 2023-10-29 15:53:56,520 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:56,523 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:53:56,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 15:53:56,524 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:53:56,526 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x36956343 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:53:56,529 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d1c74a5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:53:56,529 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:56,985 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103853010272cdd486e8a91b43bd726bb88 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103853010272cdd486e8a91b43bd726bb88 2023-10-29 15:53:56,987 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:53:57,004 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:53:57,006 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:53:57,013 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:53:57,017 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:53:57,028 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33b5016a98834b81970637bc2448486a first=Optional[r3] last=Optional[r6] 2023-10-29 15:53:57,029 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33b5016a98834b81970637bc2448486a}] 2023-10-29 15:53:57,034 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33b5016a98834b81970637bc2448486a for inclusion in bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:53:57,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 15:53:57,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:57,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:57,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/33b5016a98834b81970637bc2448486a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hn0nh0nn8pp91fas73m6e0h2r07i6nsquk5ldlnh1of7ri83fmq234lanqntv75v/family1/33b5016a98834b81970637bc2448486a 2023-10-29 15:53:57,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hn0nh0nn8pp91fas73m6e0h2r07i6nsquk5ldlnh1of7ri83fmq234lanqntv75v/family1/33b5016a98834b81970637bc2448486a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/033ae63076cc4042b0dce4062bffa30c_SeqId_44_ 2023-10-29 15:53:57,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hn0nh0nn8pp91fas73m6e0h2r07i6nsquk5ldlnh1of7ri83fmq234lanqntv75v/family1/33b5016a98834b81970637bc2448486a into bd7ee8dbf5c23af94dc862ed86a91dca/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/033ae63076cc4042b0dce4062bffa30c_SeqId_44_ - updating store file list. 2023-10-29 15:53:57,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/033ae63076cc4042b0dce4062bffa30c_SeqId_44_ into bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:53:57,049 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hn0nh0nn8pp91fas73m6e0h2r07i6nsquk5ldlnh1of7ri83fmq234lanqntv75v/family1/33b5016a98834b81970637bc2448486a into bd7ee8dbf5c23af94dc862ed86a91dca/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/033ae63076cc4042b0dce4062bffa30c_SeqId_44_) 2023-10-29 15:53:57,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__hn0nh0nn8pp91fas73m6e0h2r07i6nsquk5ldlnh1of7ri83fmq234lanqntv75v/family1/33b5016a98834b81970637bc2448486a 2023-10-29 15:53:57,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 15:53:57,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 15:53:57,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): bd7ee8dbf5c23af94dc862ed86a91dca/family1 is initiating minor compaction 2023-10-29 15:53:57,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5183d4c7; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 15:53:57,053 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bd7ee8dbf5c23af94dc862ed86a91dca/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:57,053 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/09ed51e0faf043e688b6208826eb9685, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/e7eb9e4508b349c8aad668ba39048b57, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8133046a2b754040873195f9cb0601ac, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/2b175515a81d4f88909833ab0514b125, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/25bf776311344bc6842c3f92adaf3985, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1896be5c75ff4f4e9ce72c923a0f1a70, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8dfffafa163e4d10891a66786105ba3f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/547980f01a8f4c44a5b1b6e778a7eab6, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/da60de0cbfbe48038074263c2309b97b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/033ae63076cc4042b0dce4062bffa30c_SeqId_44_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp, totalSize=50.4 K 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 09ed51e0faf043e688b6208826eb9685, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting e7eb9e4508b349c8aad668ba39048b57, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 8133046a2b754040873195f9cb0601ac, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 2b175515a81d4f88909833ab0514b125, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 25bf776311344bc6842c3f92adaf3985, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 1896be5c75ff4f4e9ce72c923a0f1a70, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 8dfffafa163e4d10891a66786105ba3f, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 547980f01a8f4c44a5b1b6e778a7eab6, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting da60de0cbfbe48038074263c2309b97b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 15:53:57,053 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 033ae63076cc4042b0dce4062bffa30c_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 15:53:57,055 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:53:57,056 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:57,057 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122816d08e884ed848b385c6e330a9c7864e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015122816d08e884ed848b385c6e330a9c7864e 2023-10-29 15:53:57,058 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231d29a560932fe4c90a47b64063b02013d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151231d29a560932fe4c90a47b64063b02013d 2023-10-29 15:53:57,060 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601010eaee333f67e44ae95304e97586e63a8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601010eaee333f67e44ae95304e97586e63a8 2023-10-29 15:53:57,061 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103936d47065cab4c8eb9648bc9fd414eb8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20160103936d47065cab4c8eb9648bc9fd414eb8 2023-10-29 15:53:57,061 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-10-29 15:53:57,061 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 15:53:57,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,062 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,085 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): bd7ee8dbf5c23af94dc862ed86a91dca#family1#compaction#59 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:57,127 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/bf8d85c8b8854d23ba35a5609043231b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/bf8d85c8b8854d23ba35a5609043231b 2023-10-29 15:53:57,132 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in bd7ee8dbf5c23af94dc862ed86a91dca/family1 of bd7ee8dbf5c23af94dc862ed86a91dca into bf8d85c8b8854d23ba35a5609043231b(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:53:57,132 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:57,132 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698594837053; duration=0sec 2023-10-29 15:53:57,132 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:57,194 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/09ed51e0faf043e688b6208826eb9685, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/e7eb9e4508b349c8aad668ba39048b57, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8133046a2b754040873195f9cb0601ac, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/2b175515a81d4f88909833ab0514b125, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/25bf776311344bc6842c3f92adaf3985, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1896be5c75ff4f4e9ce72c923a0f1a70, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8dfffafa163e4d10891a66786105ba3f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/547980f01a8f4c44a5b1b6e778a7eab6, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/da60de0cbfbe48038074263c2309b97b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/033ae63076cc4042b0dce4062bffa30c_SeqId_44_] to archive 2023-10-29 15:53:57,195 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:57,197 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/09ed51e0faf043e688b6208826eb9685 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/09ed51e0faf043e688b6208826eb9685 2023-10-29 15:53:57,198 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/e7eb9e4508b349c8aad668ba39048b57 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/e7eb9e4508b349c8aad668ba39048b57 2023-10-29 15:53:57,199 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8133046a2b754040873195f9cb0601ac to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8133046a2b754040873195f9cb0601ac 2023-10-29 15:53:57,201 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/2b175515a81d4f88909833ab0514b125 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/2b175515a81d4f88909833ab0514b125 2023-10-29 15:53:57,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/25bf776311344bc6842c3f92adaf3985 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/25bf776311344bc6842c3f92adaf3985 2023-10-29 15:53:57,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1896be5c75ff4f4e9ce72c923a0f1a70 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1896be5c75ff4f4e9ce72c923a0f1a70 2023-10-29 15:53:57,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8dfffafa163e4d10891a66786105ba3f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/8dfffafa163e4d10891a66786105ba3f 2023-10-29 15:53:57,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/547980f01a8f4c44a5b1b6e778a7eab6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/547980f01a8f4c44a5b1b6e778a7eab6 2023-10-29 15:53:57,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/da60de0cbfbe48038074263c2309b97b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/da60de0cbfbe48038074263c2309b97b 2023-10-29 15:53:57,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/033ae63076cc4042b0dce4062bffa30c_SeqId_44_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/033ae63076cc4042b0dce4062bffa30c_SeqId_44_ 2023-10-29 15:53:57,530 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055e9a1d2b59e34090ac5a564f752ceda8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512055e9a1d2b59e34090ac5a564f752ceda8 2023-10-29 15:53:57,531 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:53:57,582 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/dfcbf94a91104998be822438c3be7073 first=Optional[r00] last=Optional[r2] 2023-10-29 15:53:57,583 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/dfcbf94a91104998be822438c3be7073}] 2023-10-29 15:53:57,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/dfcbf94a91104998be822438c3be7073 for inclusion in bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:53:57,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 15:53:57,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:53:57,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:57,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/dfcbf94a91104998be822438c3be7073 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ce3ga5bhg7dvje66bb74s7ta9ihq7fa3g5fq074t6h5rin2vbspuu8v1jnr726e2/family1/dfcbf94a91104998be822438c3be7073 2023-10-29 15:53:57,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ce3ga5bhg7dvje66bb74s7ta9ihq7fa3g5fq074t6h5rin2vbspuu8v1jnr726e2/family1/dfcbf94a91104998be822438c3be7073 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/68636ad014c841979d7dbe455e00c403_SeqId_47_ 2023-10-29 15:53:57,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ce3ga5bhg7dvje66bb74s7ta9ihq7fa3g5fq074t6h5rin2vbspuu8v1jnr726e2/family1/dfcbf94a91104998be822438c3be7073 into bd7ee8dbf5c23af94dc862ed86a91dca/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/68636ad014c841979d7dbe455e00c403_SeqId_47_ - updating store file list. 2023-10-29 15:53:57,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/68636ad014c841979d7dbe455e00c403_SeqId_47_ into bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:53:57,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ce3ga5bhg7dvje66bb74s7ta9ihq7fa3g5fq074t6h5rin2vbspuu8v1jnr726e2/family1/dfcbf94a91104998be822438c3be7073 into bd7ee8dbf5c23af94dc862ed86a91dca/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/68636ad014c841979d7dbe455e00c403_SeqId_47_) 2023-10-29 15:53:57,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ce3ga5bhg7dvje66bb74s7ta9ihq7fa3g5fq074t6h5rin2vbspuu8v1jnr726e2/family1/dfcbf94a91104998be822438c3be7073 2023-10-29 15:53:57,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 15:53:57,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 15:53:57,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): bd7ee8dbf5c23af94dc862ed86a91dca/family1 is initiating minor compaction (all files) 2023-10-29 15:53:57,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@362eeb9d; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:57,603 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of bd7ee8dbf5c23af94dc862ed86a91dca/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:57,603 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1041f3b08581405cb622ac7e57e0f349, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/bf8d85c8b8854d23ba35a5609043231b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/68636ad014c841979d7dbe455e00c403_SeqId_47_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp, totalSize=390.1 K 2023-10-29 15:53:57,603 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 1041f3b08581405cb622ac7e57e0f349, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878851783 2023-10-29 15:53:57,604 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting bf8d85c8b8854d23ba35a5609043231b, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621251783 2023-10-29 15:53:57,604 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 68636ad014c841979d7dbe455e00c403_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878851783 2023-10-29 15:53:57,604 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:53:57,605 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:57,606 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113097fb136bcf73452db8e533da7b3a7027 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2015113097fb136bcf73452db8e533da7b3a7027 2023-10-29 15:53:57,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201fbebc45ecb214c87b432efd81d618ce1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201fbebc45ecb214c87b432efd81d618ce1 2023-10-29 15:53:57,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205251eacddd3494559bd09d79f2eda2c0a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151205251eacddd3494559bd09d79f2eda2c0a 2023-10-29 15:53:57,609 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-10-29 15:53:57,609 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 15:53:57,609 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:57,610 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:53:57,610 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:57,611 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:57,612 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.0930 sec 2023-10-29 15:53:57,625 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): bd7ee8dbf5c23af94dc862ed86a91dca#family1#compaction#60 average throughput is 16.42 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:53:57,723 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 15:53:57,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:58,134 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 15:53:58,135 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-10-29 15:53:58,136 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 15:53:58,138 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-29 15:53:58,140 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, REOPEN/MOVE}] 2023-10-29 15:53:58,141 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, REOPEN/MOVE 2023-10-29 15:53:58,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:58,142 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594838142"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594838142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594838142"}]},"ts":"1698594838142"} 2023-10-29 15:53:58,143 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:58,294 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:58,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:58,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bd7ee8dbf5c23af94dc862ed86a91dca, disabling compactions & flushes 2023-10-29 15:53:58,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:58,844 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/.tmp/family1/3bf4d4f653534d468d601c7d9e41f40b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/3bf4d4f653534d468d601c7d9e41f40b 2023-10-29 15:53:58,850 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in bd7ee8dbf5c23af94dc862ed86a91dca/family1 of bd7ee8dbf5c23af94dc862ed86a91dca into 3bf4d4f653534d468d601c7d9e41f40b(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:53:58,850 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:58,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:58,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:58,850 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1698594837603; duration=1sec 2023-10-29 15:53:58,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. after waiting 0 ms 2023-10-29 15:53:58,850 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:58,850 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:53:58,852 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1041f3b08581405cb622ac7e57e0f349, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/bf8d85c8b8854d23ba35a5609043231b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/68636ad014c841979d7dbe455e00c403_SeqId_47_] to archive 2023-10-29 15:53:58,853 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:53:58,855 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1041f3b08581405cb622ac7e57e0f349 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/1041f3b08581405cb622ac7e57e0f349 2023-10-29 15:53:58,856 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/bf8d85c8b8854d23ba35a5609043231b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/bf8d85c8b8854d23ba35a5609043231b 2023-10-29 15:53:58,857 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/68636ad014c841979d7dbe455e00c403_SeqId_47_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/68636ad014c841979d7dbe455e00c403_SeqId_47_ 2023-10-29 15:53:58,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-10-29 15:53:58,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:58,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:58,864 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: bd7ee8dbf5c23af94dc862ed86a91dca to self. 2023-10-29 15:53:58,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:58,866 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=CLOSED 2023-10-29 15:53:58,866 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594838866"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594838866"}]},"ts":"1698594838866"} 2023-10-29 15:53:58,868 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=45 2023-10-29 15:53:58,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651 in 724 msec 2023-10-29 15:53:58,869 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=true 2023-10-29 15:53:59,019 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:59,020 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594839019"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594839019"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594839019"}]},"ts":"1698594839019"} 2023-10-29 15:53:59,021 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:53:59,173 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:59,179 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:59,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd7ee8dbf5c23af94dc862ed86a91dca, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:53:59,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:59,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:53:59,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:59,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:59,184 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:59,187 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:53:59,187 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:53:59,188 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd7ee8dbf5c23af94dc862ed86a91dca columnFamilyName family1 2023-10-29 15:53:59,198 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/3bf4d4f653534d468d601c7d9e41f40b 2023-10-29 15:53:59,199 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(310): Store=bd7ee8dbf5c23af94dc862ed86a91dca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:53:59,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:59,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:59,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:53:59,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bd7ee8dbf5c23af94dc862ed86a91dca; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68334847, jitterRate=0.01826857030391693}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:53:59,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:53:59,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca., pid=47, masterSystemTime=1698594839173 2023-10-29 15:53:59,209 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:59,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:53:59,210 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:53:59,210 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594839210"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594839210"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594839210"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594839210"}]},"ts":"1698594839210"} 2023-10-29 15:53:59,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=47, resume processing ppid=45 2023-10-29 15:53:59,214 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651 in 191 msec 2023-10-29 15:53:59,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=44 2023-10-29 15:53:59,217 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, REOPEN/MOVE in 1.0740 sec 2023-10-29 15:53:59,220 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=43 2023-10-29 15:53:59,220 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0800 sec 2023-10-29 15:53:59,222 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.4980 sec 2023-10-29 15:53:59,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-10-29 15:53:59,224 INFO [Listener at localhost/37167] compactions.TestMobCompactor(278): alter status finished 2023-10-29 15:53:59,225 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:53:59,226 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:59,227 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:53:59,227 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595439227 2023-10-29 15:53:59,227 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:53:59,228 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:53:59,229 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 15:53:59,229 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:53:59,231 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x0a56c3e3 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:53:59,235 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34d12750, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:53:59,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:59,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:59,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:59,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:53:59,235 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:00,062 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128166d241bb1f84cf8a7dfeaecbddc36d6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128166d241bb1f84cf8a7dfeaecbddc36d6 2023-10-29 15:54:00,064 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:54:00,077 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:54:00,078 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57466, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:54:00,089 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:54:00,092 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:54:00,106 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a7a7305a8d4049c58d6cc932468a4884 first=Optional[r05] last=Optional[r8] 2023-10-29 15:54:00,107 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=51 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a7a7305a8d4049c58d6cc932468a4884}] 2023-10-29 15:54:00,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a7a7305a8d4049c58d6cc932468a4884 for inclusion in bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:54:00,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 15:54:00,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:54:00,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:54:00,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a7a7305a8d4049c58d6cc932468a4884 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pajilt45uduh6n2r5kh659jveihfc7sa6km8de8od0assa6pgbqvsfldhaijshok/family1/a7a7305a8d4049c58d6cc932468a4884 2023-10-29 15:54:00,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pajilt45uduh6n2r5kh659jveihfc7sa6km8de8od0assa6pgbqvsfldhaijshok/family1/a7a7305a8d4049c58d6cc932468a4884 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/3b262c3cef6f4c3bb711b88655f7dcf1_SeqId_53_ 2023-10-29 15:54:00,132 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pajilt45uduh6n2r5kh659jveihfc7sa6km8de8od0assa6pgbqvsfldhaijshok/family1/a7a7305a8d4049c58d6cc932468a4884 into bd7ee8dbf5c23af94dc862ed86a91dca/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/3b262c3cef6f4c3bb711b88655f7dcf1_SeqId_53_ - updating store file list. 2023-10-29 15:54:00,136 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/3b262c3cef6f4c3bb711b88655f7dcf1_SeqId_53_ into bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:54:00,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pajilt45uduh6n2r5kh659jveihfc7sa6km8de8od0assa6pgbqvsfldhaijshok/family1/a7a7305a8d4049c58d6cc932468a4884 into bd7ee8dbf5c23af94dc862ed86a91dca/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/3b262c3cef6f4c3bb711b88655f7dcf1_SeqId_53_) 2023-10-29 15:54:00,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__pajilt45uduh6n2r5kh659jveihfc7sa6km8de8od0assa6pgbqvsfldhaijshok/family1/a7a7305a8d4049c58d6cc932468a4884 2023-10-29 15:54:00,139 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:54:00,140 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:00,142 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ac8c2bb597244771b1d9ff1562b34ee5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ac8c2bb597244771b1d9ff1562b34ee5 2023-10-29 15:54:00,143 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283c0f4712bf3349879920f99a68fd8764 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511283c0f4712bf3349879920f99a68fd8764 2023-10-29 15:54:00,143 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-10-29 15:54:00,143 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 15:54:00,144 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:00,144 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:00,144 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:00,144 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:54:00,144 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:00,145 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:54:00,146 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 920 msec 2023-10-29 15:54:00,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 15:54:00,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:54:00,621 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-29 15:54:00,622 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-10-29 15:54:00,622 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-10-29 15:54:00,634 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-10-29 15:54:00,637 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, REOPEN/MOVE}] 2023-10-29 15:54:00,638 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, REOPEN/MOVE 2023-10-29 15:54:00,639 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:00,639 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594840639"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594840639"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594840639"}]},"ts":"1698594840639"} 2023-10-29 15:54:00,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:00,792 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:00,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:00,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bd7ee8dbf5c23af94dc862ed86a91dca, disabling compactions & flushes 2023-10-29 15:54:00,793 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:54:00,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:54:00,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. after waiting 0 ms 2023-10-29 15:54:00,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:54:00,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-29 15:54:00,809 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:54:00,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:54:00,809 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: bd7ee8dbf5c23af94dc862ed86a91dca to self. 2023-10-29 15:54:00,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:00,811 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=CLOSED 2023-10-29 15:54:00,811 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594840811"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594840811"}]},"ts":"1698594840811"} 2023-10-29 15:54:00,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-10-29 15:54:00,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651 in 171 msec 2023-10-29 15:54:00,814 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=true 2023-10-29 15:54:00,964 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:00,964 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594840964"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594840964"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594840964"}]},"ts":"1698594840964"} 2023-10-29 15:54:00,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:01,118 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:01,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:54:01,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bd7ee8dbf5c23af94dc862ed86a91dca, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:54:01,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:01,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:01,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:01,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:01,123 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:01,124 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:54:01,124 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1 2023-10-29 15:54:01,125 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bd7ee8dbf5c23af94dc862ed86a91dca columnFamilyName family1 2023-10-29 15:54:01,133 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/3b262c3cef6f4c3bb711b88655f7dcf1_SeqId_53_ 2023-10-29 15:54:01,138 DEBUG [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/family1/3bf4d4f653534d468d601c7d9e41f40b 2023-10-29 15:54:01,138 INFO [StoreOpener-bd7ee8dbf5c23af94dc862ed86a91dca-1] regionserver.HStore(310): Store=bd7ee8dbf5c23af94dc862ed86a91dca/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:01,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:01,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:01,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:54:01,144 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bd7ee8dbf5c23af94dc862ed86a91dca; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64155291, jitterRate=-0.044011667370796204}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:54:01,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:54:01,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca., pid=53, masterSystemTime=1698594841118 2023-10-29 15:54:01,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:54:01,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:54:01,147 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=bd7ee8dbf5c23af94dc862ed86a91dca, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:01,147 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1698594841147"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594841147"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594841147"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594841147"}]},"ts":"1698594841147"} 2023-10-29 15:54:01,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-10-29 15:54:01,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure bd7ee8dbf5c23af94dc862ed86a91dca, server=jenkins-hbase20.apache.org,44603,1698594767651 in 183 msec 2023-10-29 15:54:01,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=51, resume processing ppid=50 2023-10-29 15:54:01,152 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=bd7ee8dbf5c23af94dc862ed86a91dca, REOPEN/MOVE in 513 msec 2023-10-29 15:54:01,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=50, resume processing ppid=49 2023-10-29 15:54:01,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 519 msec 2023-10-29 15:54:01,157 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 948 msec 2023-10-29 15:54:01,158 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-10-29 15:54:01,159 INFO [Listener at localhost/37167] compactions.TestMobCompactor(278): alter status finished 2023-10-29 15:54:01,160 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-10-29 15:54:01,162 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:54:01,163 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:54:01,164 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595441164 2023-10-29 15:54:01,164 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:01,165 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:54:01,165 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-10-29 15:54:01,165 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:54:01,166 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x1fd213f1 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:01,170 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@22845cfc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:01,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:01,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:01,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:01,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:01,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:01,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:01,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:01,170 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-10-29 15:54:01,170 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-10-29 15:54:01,171 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:01,172 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-10-29 15:54:01,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-10-29 15:54:01,224 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=247 (was 256), OpenFileDescriptor=630 (was 616) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=215 (was 254), ProcessCount=168 (was 168), AvailableMemoryMB=2772 (was 3070) 2023-10-29 15:54:01,234 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=247, OpenFileDescriptor=630, MaxFileDescriptor=60000, SystemLoadAverage=215, ProcessCount=168, AvailableMemoryMB=2771 2023-10-29 15:54:01,236 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-10-29 15:54:01,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:01,238 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:54:01,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-10-29 15:54:01,239 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:54:01,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 15:54:01,240 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:01,240 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 empty. 2023-10-29 15:54:01,241 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:01,241 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-10-29 15:54:01,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 15:54:01,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 15:54:01,652 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-29 15:54:01,653 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0e6ad0e66f54da66125626b190d2f026, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:54:01,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 15:54:02,060 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:02,060 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing 0e6ad0e66f54da66125626b190d2f026, disabling compactions & flushes 2023-10-29 15:54:02,060 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:02,060 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:02,060 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. after waiting 0 ms 2023-10-29 15:54:02,060 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:02,060 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:02,060 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:02,062 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:54:02,063 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594842063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594842063"}]},"ts":"1698594842063"} 2023-10-29 15:54:02,064 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:54:02,065 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:54:02,065 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594842065"}]},"ts":"1698594842065"} 2023-10-29 15:54:02,066 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-10-29 15:54:02,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, ASSIGN}] 2023-10-29 15:54:02,069 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, ASSIGN 2023-10-29 15:54:02,070 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:54:02,221 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:02,221 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594842221"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594842221"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594842221"}]},"ts":"1698594842221"} 2023-10-29 15:54:02,223 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:02,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 15:54:02,375 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:02,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:02,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e6ad0e66f54da66125626b190d2f026, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:54:02,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:02,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:02,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:02,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:02,380 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:02,381 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:02,381 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:02,381 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e6ad0e66f54da66125626b190d2f026 columnFamilyName family1 2023-10-29 15:54:02,383 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(310): Store=0e6ad0e66f54da66125626b190d2f026/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:02,384 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:02,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:02,387 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:02,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:54:02,389 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0e6ad0e66f54da66125626b190d2f026; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71498208, jitterRate=0.06540632247924805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:54:02,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:02,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026., pid=57, masterSystemTime=1698594842375 2023-10-29 15:54:02,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:02,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:02,392 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:02,392 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594842392"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594842392"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594842392"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594842392"}]},"ts":"1698594842392"} 2023-10-29 15:54:02,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=57, resume processing ppid=56 2023-10-29 15:54:02,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651 in 170 msec 2023-10-29 15:54:02,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=56, resume processing ppid=55 2023-10-29 15:54:02,397 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, ASSIGN in 327 msec 2023-10-29 15:54:02,399 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:54:02,399 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594842399"}]},"ts":"1698594842399"} 2023-10-29 15:54:02,400 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-10-29 15:54:02,402 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:54:02,405 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1670 sec 2023-10-29 15:54:03,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-10-29 15:54:03,344 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-10-29 15:54:03,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:03,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:03,372 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:03,372 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:03,372 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:03,372 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:03,373 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:03,373 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:03,373 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:03,373 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:03,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:03,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:03,374 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:03,374 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:03,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:03,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:03,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:03,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:03,374 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:03,375 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:03,375 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:03,375 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:03,375 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:03,375 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:03,375 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:03,375 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:03,375 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:03,376 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 15:54:03,803 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113050bc90901bdc4fe4b48bfa4062e42955 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113050bc90901bdc4fe4b48bfa4062e42955 2023-10-29 15:54:04,209 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/81a43f3b0348471aa62d4054e9321940 2023-10-29 15:54:04,219 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/81a43f3b0348471aa62d4054e9321940 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/81a43f3b0348471aa62d4054e9321940 2023-10-29 15:54:04,223 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/81a43f3b0348471aa62d4054e9321940, entries=1000, sequenceid=5, filesize=190.5 K 2023-10-29 15:54:04,224 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 849ms, sequenceid=5, compaction requested=false 2023-10-29 15:54:04,224 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:04,225 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:04,225 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:04,225 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:04,225 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:04,225 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,225 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:04,225 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:04,226 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,226 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:04,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:04,227 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,227 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:04,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:04,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:04,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:04,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:04,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@13f72469[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:04,228 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:04,228 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,228 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,229 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:04,229 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:04,229 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:04,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:04,229 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:04,229 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:04,230 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:04,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:04,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:04,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:04,232 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:04,232 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:04,232 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:04,232 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,232 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:04,233 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,233 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:04,233 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:04,233 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,235 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:04,238 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:04,238 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:04,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:04,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:04,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,238 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:04,239 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:04,339 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:04,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:04,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:04,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:04,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,345 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:04,345 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:04,345 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:04,345 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:04,346 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,346 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,346 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:04,346 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:04,346 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:04,347 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:04,347 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:04,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,347 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,347 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:04,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:04,348 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:04,348 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:04,348 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:04,348 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:04,348 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:04,348 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:04,348 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:04,348 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 15:54:04,393 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:54:04,761 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128d2d72efc1ac9426c903d877307628cdc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2d72efc1ac9426c903d877307628cdc 2023-10-29 15:54:05,170 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/bdda83f1c6c84663aa404929ee9e9eb5 2023-10-29 15:54:05,181 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/bdda83f1c6c84663aa404929ee9e9eb5 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/bdda83f1c6c84663aa404929ee9e9eb5 2023-10-29 15:54:05,189 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/bdda83f1c6c84663aa404929ee9e9eb5, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 15:54:05,190 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 842ms, sequenceid=9, compaction requested=false 2023-10-29 15:54:05,190 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:05,190 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:05,190 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:05,190 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:05,190 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,190 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:05,190 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:05,192 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,192 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:05,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:05,192 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,193 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:05,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:05,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:05,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:05,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@604d06fa[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:05,195 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:05,195 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,196 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,196 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:05,196 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:05,196 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:05,196 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,196 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:05,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:05,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:05,198 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:05,197 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:05,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:05,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:05,201 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:05,202 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:05,202 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:05,202 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:05,202 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,202 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:05,204 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,204 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:05,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,204 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:05,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:05,205 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:05,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,212 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,212 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:05,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:05,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:05,213 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,213 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:05,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:05,313 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:05,315 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:05,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:05,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:05,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,329 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:05,329 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:05,329 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:05,329 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:05,330 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,330 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,331 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:05,331 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:05,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:05,331 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:05,331 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:05,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,332 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:05,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,333 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,333 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:05,334 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:05,334 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:05,334 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:05,334 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:05,334 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:05,334 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:05,334 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:05,334 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:05,334 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:54:05,758 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201c00f7ee588d244b2a30cee89c4daa582 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201c00f7ee588d244b2a30cee89c4daa582 2023-10-29 15:54:06,167 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/ca8795efc53e47a2a9cec552daf741bf 2023-10-29 15:54:06,179 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/ca8795efc53e47a2a9cec552daf741bf as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ca8795efc53e47a2a9cec552daf741bf 2023-10-29 15:54:06,183 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ca8795efc53e47a2a9cec552daf741bf, entries=1, sequenceid=13, filesize=5.0 K 2023-10-29 15:54:06,184 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 850ms, sequenceid=13, compaction requested=true 2023-10-29 15:54:06,184 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:06,184 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:06,184 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:06,184 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:06,184 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,184 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:06,184 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:06,185 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,185 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:06,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:06,185 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,186 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:06,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:06,187 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2ef3cf68[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:06,187 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:06,187 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,187 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,187 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:06,187 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:06,187 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:06,187 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,187 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:06,188 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:06,188 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,188 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:06,188 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:06,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:06,190 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:06,190 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:06,190 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:06,190 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:06,190 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,190 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:06,191 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,191 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:06,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,191 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:06,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:06,191 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:06,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,192 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:06,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:06,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:06,194 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:06,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:06,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:06,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:06,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:06,195 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 15:54:06,195 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:06,195 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:06,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:06,195 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:06,295 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:06,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:06,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:06,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:06,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,302 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:06,302 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:06,302 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:06,302 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:06,303 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,303 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,304 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:06,304 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,304 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:06,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:06,305 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:06,305 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:06,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,305 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:06,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,306 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,306 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:06,306 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:06,306 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:06,306 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:06,306 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:06,306 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:06,306 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:06,306 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:06,306 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:06,307 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:54:06,730 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512054c556609a75c44bb8e811ef2214ac7cf to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054c556609a75c44bb8e811ef2214ac7cf 2023-10-29 15:54:07,138 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/67ea727dade04937945b8710e6ead673 2023-10-29 15:54:07,144 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/67ea727dade04937945b8710e6ead673 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/67ea727dade04937945b8710e6ead673 2023-10-29 15:54:07,151 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/67ea727dade04937945b8710e6ead673, entries=1, sequenceid=17, filesize=5.0 K 2023-10-29 15:54:07,152 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 845ms, sequenceid=17, compaction requested=true 2023-10-29 15:54:07,152 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:07,152 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:07,152 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:07,152 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:07,152 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,152 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:07,152 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:07,156 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,156 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:07,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:07,157 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,157 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:07,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:07,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:07,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:07,160 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@52b63d78[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:07,160 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:07,160 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,196 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:07,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:07,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:07,197 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,197 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:07,199 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,199 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:07,200 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:07,200 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:07,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:07,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:07,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:07,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:07,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:07,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:07,210 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:07,210 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:07,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:07,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:07,210 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,210 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:07,219 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,219 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:07,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,219 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:07,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:07,221 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:07,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:07,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,224 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:07,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:07,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:07,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:07,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:07,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:07,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:07,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:07,229 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,230 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,230 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,230 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 15:54:07,230 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:07,230 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:07,230 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:07,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:07,230 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,330 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:07,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:07,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:07,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:07,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,341 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:07,341 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:07,341 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:07,342 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:07,342 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,342 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,343 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:07,343 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:07,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:07,344 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:07,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,344 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:07,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:07,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,345 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,345 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:07,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:07,345 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:07,345 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:07,345 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:07,346 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:07,346 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:07,346 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:07,346 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:07,346 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:54:07,764 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284cae5664c6e04421b4a7e59cad1decbe to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512284cae5664c6e04421b4a7e59cad1decbe 2023-10-29 15:54:08,174 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/08985af8c82c42a689f6910975c4f5f0 2023-10-29 15:54:08,188 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/08985af8c82c42a689f6910975c4f5f0 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/08985af8c82c42a689f6910975c4f5f0 2023-10-29 15:54:08,195 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/08985af8c82c42a689f6910975c4f5f0, entries=1, sequenceid=21, filesize=5.0 K 2023-10-29 15:54:08,196 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 850ms, sequenceid=21, compaction requested=true 2023-10-29 15:54:08,196 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:08,197 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:08,197 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:08,198 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,198 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:08,199 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,199 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:08,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:08,200 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@78488f2b[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:08,200 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:08,200 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,201 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,201 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:08,201 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,201 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:08,201 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:08,201 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:08,202 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:08,202 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,202 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:08,202 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:08,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:08,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:08,204 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:08,204 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:08,204 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:08,204 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:08,204 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,204 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:08,205 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,205 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:08,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:08,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,205 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:08,206 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:08,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,208 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:08,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:08,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:08,208 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:08,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:08,208 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:08,209 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:08,309 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:08,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:08,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:08,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:08,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,320 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:08,320 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:08,320 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:08,320 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:08,321 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,321 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,322 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:08,322 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:08,323 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,323 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:08,324 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,324 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,325 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:08,325 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:08,325 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:08,325 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:08,325 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:08,325 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:08,325 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:08,325 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:08,325 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:08,325 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:54:08,749 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231f0e2dd832d8c4dbfb35395581d89d4ff to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f0e2dd832d8c4dbfb35395581d89d4ff 2023-10-29 15:54:09,157 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/d63e3396e8824a259a02c2e2d6353ceb 2023-10-29 15:54:09,169 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/d63e3396e8824a259a02c2e2d6353ceb as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/d63e3396e8824a259a02c2e2d6353ceb 2023-10-29 15:54:09,174 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/d63e3396e8824a259a02c2e2d6353ceb, entries=1, sequenceid=25, filesize=5.0 K 2023-10-29 15:54:09,175 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 850ms, sequenceid=25, compaction requested=true 2023-10-29 15:54:09,175 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:09,175 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:09,175 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:09,175 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:09,175 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,175 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:09,175 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:09,176 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,176 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:09,177 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,177 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:09,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:09,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:09,178 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70ba2c0e[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:09,178 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:09,178 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,179 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,179 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:09,180 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:09,180 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:09,180 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,180 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:09,181 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,181 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:09,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:09,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:09,181 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:09,181 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:09,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:09,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:09,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:09,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:09,185 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:09,185 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:09,185 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:09,185 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:09,185 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,185 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:09,188 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,188 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:09,188 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,188 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:09,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:09,188 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,189 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:09,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,191 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:09,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:09,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 15:54:09,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:09,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:09,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:09,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:09,194 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:09,194 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,195 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,195 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,195 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:09,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:09,195 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,195 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:09,195 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:09,295 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:09,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:09,300 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:09,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:09,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,302 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:09,302 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:09,302 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:09,302 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:09,302 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,302 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,303 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:09,303 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:09,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:09,304 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:09,304 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:09,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:09,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,305 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,305 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:09,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:09,305 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:09,305 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:09,305 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:09,305 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:09,305 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:09,305 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:09,305 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:09,306 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:54:09,723 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101cd825e3a03ef44dca88a2c375e9d0595 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101cd825e3a03ef44dca88a2c375e9d0595 2023-10-29 15:54:10,133 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/c3eff63a43994d6680271f1f5ffbea07 2023-10-29 15:54:10,140 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/c3eff63a43994d6680271f1f5ffbea07 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/c3eff63a43994d6680271f1f5ffbea07 2023-10-29 15:54:10,147 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/c3eff63a43994d6680271f1f5ffbea07, entries=1, sequenceid=29, filesize=5.0 K 2023-10-29 15:54:10,148 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 842ms, sequenceid=29, compaction requested=true 2023-10-29 15:54:10,148 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:10,148 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:10,148 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:10,148 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:10,148 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,148 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:10,148 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:10,150 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,150 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:10,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:10,150 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,150 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:10,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:10,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:10,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:10,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@400235fe[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:10,153 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:10,153 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,154 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,154 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:10,154 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:10,154 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:10,154 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,154 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:10,155 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:10,155 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:10,155 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,155 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:10,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:10,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:10,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:10,158 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:10,158 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:10,158 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:10,158 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:10,158 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,158 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:10,159 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,159 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:10,159 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:10,160 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:10,160 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,161 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:10,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,162 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,162 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:10,162 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,162 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:10,162 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:10,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 15:54:10,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:10,163 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:10,163 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:10,163 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,163 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,163 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:10,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:10,163 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,163 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:10,163 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,163 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:10,263 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:10,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:10,269 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:10,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:10,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,271 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:10,271 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:10,271 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:10,271 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:10,271 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,271 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,272 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,272 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:10,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:10,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:10,273 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:10,273 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:10,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,273 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:10,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,274 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,274 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:10,274 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:10,274 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:10,274 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:10,274 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:10,274 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:10,274 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:10,274 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:10,274 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:10,274 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:54:10,701 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601033680f68545884d81bb230584b25ba56b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601033680f68545884d81bb230584b25ba56b 2023-10-29 15:54:11,109 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/b86b10ab0d04454b90d3005a8b83231c 2023-10-29 15:54:11,121 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/b86b10ab0d04454b90d3005a8b83231c as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b86b10ab0d04454b90d3005a8b83231c 2023-10-29 15:54:11,127 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b86b10ab0d04454b90d3005a8b83231c, entries=1, sequenceid=33, filesize=5.0 K 2023-10-29 15:54:11,128 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 854ms, sequenceid=33, compaction requested=true 2023-10-29 15:54:11,128 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:11,128 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:11,128 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:11,128 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:11,128 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,128 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:11,128 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:11,130 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,130 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:11,130 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,130 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:11,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:11,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:11,132 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23bc8d7b[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:11,132 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:11,132 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,133 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,133 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:11,133 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:11,133 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:11,133 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,133 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:11,134 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,134 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:11,134 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:11,134 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:11,136 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:11,136 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:11,137 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:11,137 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:11,137 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,137 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:11,138 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,138 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:11,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,138 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,138 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:11,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:11,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,139 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,140 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:11,140 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:11,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:11,141 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:11,141 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:11,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,141 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:11,141 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:11,241 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:11,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:11,249 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:11,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:11,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,252 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:11,252 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:11,252 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:11,252 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:11,253 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,253 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,254 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,254 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:11,254 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:11,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:11,254 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:11,254 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:11,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,255 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:11,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,256 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,256 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:11,256 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:11,256 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:11,256 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:11,256 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:11,256 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:11,256 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:11,256 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:11,256 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:11,256 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:54:11,672 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509077986efd456d849dd8daddc4701c1aacb to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201509077986efd456d849dd8daddc4701c1aacb 2023-10-29 15:54:12,079 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/ea8462617b694b1e86cb5a53c3c8eef1 2023-10-29 15:54:12,090 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/ea8462617b694b1e86cb5a53c3c8eef1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ea8462617b694b1e86cb5a53c3c8eef1 2023-10-29 15:54:12,097 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ea8462617b694b1e86cb5a53c3c8eef1, entries=1, sequenceid=37, filesize=5.0 K 2023-10-29 15:54:12,098 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 842ms, sequenceid=37, compaction requested=true 2023-10-29 15:54:12,099 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:12,099 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:12,099 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:12,099 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:12,099 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,099 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:12,099 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:12,100 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,100 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:12,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:12,101 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,101 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:12,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:12,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:12,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:12,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:12,103 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fb16ff0[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:12,103 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:12,103 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,104 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,104 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:12,104 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:12,104 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:12,104 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,104 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:12,105 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:12,105 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:12,105 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,105 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:12,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:12,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:12,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:12,107 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:12,107 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:12,107 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:12,107 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,107 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:12,108 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,108 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:12,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:12,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,108 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:12,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:12,109 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,110 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:12,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,112 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:12,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:12,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:12,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:12,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:12,112 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,113 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:12,113 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,213 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:12,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:12,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:12,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:12,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,228 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:12,228 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:12,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-10-29 15:54:12,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-10-29 15:54:12,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,231 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:12,231 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:12,232 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:12,232 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:12,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,233 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,234 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,234 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-10-29 15:54:12,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:12,234 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-10-29 15:54:12,234 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:12,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-10-29 15:54:12,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:54:12,235 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:12,235 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:12,235 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. started... 2023-10-29 15:54:12,235 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 0e6ad0e66f54da66125626b190d2f026 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:54:12,660 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206ccea55fd4724064abeabd4a7a02852e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511206ccea55fd4724064abeabd4a7a02852e 2023-10-29 15:54:13,066 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/91db1032b4574a7aba30c17b74fdd447 2023-10-29 15:54:13,072 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/91db1032b4574a7aba30c17b74fdd447 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/91db1032b4574a7aba30c17b74fdd447 2023-10-29 15:54:13,077 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/91db1032b4574a7aba30c17b74fdd447, entries=1, sequenceid=41, filesize=5.0 K 2023-10-29 15:54:13,078 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 0e6ad0e66f54da66125626b190d2f026 in 843ms, sequenceid=41, compaction requested=true 2023-10-29 15:54:13,078 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:13,078 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:13,078 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:54:13,078 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:54:13,078 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,078 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-10-29 15:54:13,078 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-10-29 15:54:13,080 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,080 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:13,080 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,080 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:13,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:13,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-10-29 15:54:13,082 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3e4aea54[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:13,082 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-10-29 15:54:13,082 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,083 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-10-29 15:54:13,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-10-29 15:54:13,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:13,083 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,083 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:13,084 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-10-29 15:54:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:13,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:13,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-10-29 15:54:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:13,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:13,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:13,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-10-29 15:54:13,086 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-10-29 15:54:13,086 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:13,086 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:13,086 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,086 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:13,088 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,088 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,088 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:13,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:13,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:13,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:13,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:13,089 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,091 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:13,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,093 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,093 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:13,093 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:13,093 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:13,093 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:13,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:13,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-10-29 15:54:13,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:13,093 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,093 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:13,093 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:13,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:13,094 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,094 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:13,094 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,094 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:13,195 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:13,196 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:13,197 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:13,199 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:13,199 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:13,200 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595453200 2023-10-29 15:54:13,200 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:13,203 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:54:13,204 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 15:54:13,204 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:13,206 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x09840a13 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:13,211 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7149e488, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:13,212 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,051 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031f008637f2584816a5377e681306cfab to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601031f008637f2584816a5377e681306cfab 2023-10-29 15:54:14,052 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:14,065 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:54:14,066 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:54:14,073 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:54:14,074 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:54:14,083 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/208f5488873b47d1bc7edf54465e4e94 first=Optional[r3] last=Optional[r6] 2023-10-29 15:54:14,084 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/208f5488873b47d1bc7edf54465e4e94}] 2023-10-29 15:54:14,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/208f5488873b47d1bc7edf54465e4e94 for inclusion in 0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:14,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-10-29 15:54:14,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:54:14,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:14,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/208f5488873b47d1bc7edf54465e4e94 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__92556u4bg9tqg68qs1r0rq87em7d20gv974t26qc6j80kkur3hkb1ntad3k1lpr3/family1/208f5488873b47d1bc7edf54465e4e94 2023-10-29 15:54:14,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__92556u4bg9tqg68qs1r0rq87em7d20gv974t26qc6j80kkur3hkb1ntad3k1lpr3/family1/208f5488873b47d1bc7edf54465e4e94 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/61d3cd1edd3b46409c120892f96e1f65_SeqId_44_ 2023-10-29 15:54:14,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__92556u4bg9tqg68qs1r0rq87em7d20gv974t26qc6j80kkur3hkb1ntad3k1lpr3/family1/208f5488873b47d1bc7edf54465e4e94 into 0e6ad0e66f54da66125626b190d2f026/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/61d3cd1edd3b46409c120892f96e1f65_SeqId_44_ - updating store file list. 2023-10-29 15:54:14,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/61d3cd1edd3b46409c120892f96e1f65_SeqId_44_ into 0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:14,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__92556u4bg9tqg68qs1r0rq87em7d20gv974t26qc6j80kkur3hkb1ntad3k1lpr3/family1/208f5488873b47d1bc7edf54465e4e94 into 0e6ad0e66f54da66125626b190d2f026/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/61d3cd1edd3b46409c120892f96e1f65_SeqId_44_) 2023-10-29 15:54:14,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__92556u4bg9tqg68qs1r0rq87em7d20gv974t26qc6j80kkur3hkb1ntad3k1lpr3/family1/208f5488873b47d1bc7edf54465e4e94 2023-10-29 15:54:14,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 15:54:14,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 15:54:14,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): 0e6ad0e66f54da66125626b190d2f026/family1 is initiating minor compaction 2023-10-29 15:54:14,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5645fd0f; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:54:14,103 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0e6ad0e66f54da66125626b190d2f026/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:14,103 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/bdda83f1c6c84663aa404929ee9e9eb5, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ca8795efc53e47a2a9cec552daf741bf, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/67ea727dade04937945b8710e6ead673, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/08985af8c82c42a689f6910975c4f5f0, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/d63e3396e8824a259a02c2e2d6353ceb, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/c3eff63a43994d6680271f1f5ffbea07, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b86b10ab0d04454b90d3005a8b83231c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ea8462617b694b1e86cb5a53c3c8eef1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/91db1032b4574a7aba30c17b74fdd447, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/61d3cd1edd3b46409c120892f96e1f65_SeqId_44_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp, totalSize=50.3 K 2023-10-29 15:54:14,103 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting bdda83f1c6c84663aa404929ee9e9eb5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 15:54:14,103 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting ca8795efc53e47a2a9cec552daf741bf, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 15:54:14,103 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 67ea727dade04937945b8710e6ead673, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 15:54:14,103 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 08985af8c82c42a689f6910975c4f5f0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 15:54:14,103 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting d63e3396e8824a259a02c2e2d6353ceb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 15:54:14,103 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting c3eff63a43994d6680271f1f5ffbea07, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 15:54:14,103 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting b86b10ab0d04454b90d3005a8b83231c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 15:54:14,103 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting ea8462617b694b1e86cb5a53c3c8eef1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 15:54:14,104 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 91db1032b4574a7aba30c17b74fdd447, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 15:54:14,104 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 61d3cd1edd3b46409c120892f96e1f65_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 15:54:14,105 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:14,106 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:14,107 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512284cae5664c6e04421b4a7e59cad1decbe to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512284cae5664c6e04421b4a7e59cad1decbe 2023-10-29 15:54:14,108 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f0e2dd832d8c4dbfb35395581d89d4ff to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231f0e2dd832d8c4dbfb35395581d89d4ff 2023-10-29 15:54:14,110 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101cd825e3a03ef44dca88a2c375e9d0595 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101cd825e3a03ef44dca88a2c375e9d0595 2023-10-29 15:54:14,111 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601033680f68545884d81bb230584b25ba56b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201601033680f68545884d81bb230584b25ba56b 2023-10-29 15:54:14,111 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-10-29 15:54:14,111 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-10-29 15:54:14,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,112 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,136 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0e6ad0e66f54da66125626b190d2f026#family1#compaction#71 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:14,561 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cf0673f268604b028c3f57342df34b9f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205cf0673f268604b028c3f57342df34b9f 2023-10-29 15:54:14,563 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:14,586 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b3d9f0ef7824d70ba2b62c8710692ac first=Optional[r00] last=Optional[r2] 2023-10-29 15:54:14,587 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b3d9f0ef7824d70ba2b62c8710692ac}] 2023-10-29 15:54:14,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b3d9f0ef7824d70ba2b62c8710692ac for inclusion in 0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:14,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-10-29 15:54:14,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:54:14,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:14,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/8b3d9f0ef7824d70ba2b62c8710692ac to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t0r6u6u190jqt6697e4m7dfi37r5ko83oulfhcm6qnoogf8rrh1ajlga1f6prk4a/family1/8b3d9f0ef7824d70ba2b62c8710692ac 2023-10-29 15:54:14,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t0r6u6u190jqt6697e4m7dfi37r5ko83oulfhcm6qnoogf8rrh1ajlga1f6prk4a/family1/8b3d9f0ef7824d70ba2b62c8710692ac as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_ 2023-10-29 15:54:14,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t0r6u6u190jqt6697e4m7dfi37r5ko83oulfhcm6qnoogf8rrh1ajlga1f6prk4a/family1/8b3d9f0ef7824d70ba2b62c8710692ac into 0e6ad0e66f54da66125626b190d2f026/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_ - updating store file list. 2023-10-29 15:54:14,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_ into 0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:14,601 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t0r6u6u190jqt6697e4m7dfi37r5ko83oulfhcm6qnoogf8rrh1ajlga1f6prk4a/family1/8b3d9f0ef7824d70ba2b62c8710692ac into 0e6ad0e66f54da66125626b190d2f026/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_) 2023-10-29 15:54:14,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__t0r6u6u190jqt6697e4m7dfi37r5ko83oulfhcm6qnoogf8rrh1ajlga1f6prk4a/family1/8b3d9f0ef7824d70ba2b62c8710692ac 2023-10-29 15:54:14,603 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:14,604 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:14,607 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113050bc90901bdc4fe4b48bfa4062e42955 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015113050bc90901bdc4fe4b48bfa4062e42955 2023-10-29 15:54:14,608 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201c00f7ee588d244b2a30cee89c4daa582 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151201c00f7ee588d244b2a30cee89c4daa582 2023-10-29 15:54:14,609 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054c556609a75c44bb8e811ef2214ac7cf to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512054c556609a75c44bb8e811ef2214ac7cf 2023-10-29 15:54:14,609 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-10-29 15:54:14,609 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-10-29 15:54:14,610 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:14,610 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:14,610 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:14,611 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:14,612 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.4130 sec 2023-10-29 15:54:14,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 15:54:14,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:14,958 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/b92f17a61611478cb31fc27b8a9eb557 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b92f17a61611478cb31fc27b8a9eb557 2023-10-29 15:54:14,963 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 0e6ad0e66f54da66125626b190d2f026/family1 of 0e6ad0e66f54da66125626b190d2f026 into b92f17a61611478cb31fc27b8a9eb557(size=6.8 K), total size for store is 388.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:54:14,963 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:14,963 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1698594854103; duration=0sec 2023-10-29 15:54:14,963 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:54:14,994 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/bdda83f1c6c84663aa404929ee9e9eb5, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ca8795efc53e47a2a9cec552daf741bf, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/67ea727dade04937945b8710e6ead673, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/08985af8c82c42a689f6910975c4f5f0, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/d63e3396e8824a259a02c2e2d6353ceb, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/c3eff63a43994d6680271f1f5ffbea07, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b86b10ab0d04454b90d3005a8b83231c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ea8462617b694b1e86cb5a53c3c8eef1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/91db1032b4574a7aba30c17b74fdd447, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/61d3cd1edd3b46409c120892f96e1f65_SeqId_44_] to archive 2023-10-29 15:54:14,995 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:14,997 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/bdda83f1c6c84663aa404929ee9e9eb5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/bdda83f1c6c84663aa404929ee9e9eb5 2023-10-29 15:54:14,998 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ca8795efc53e47a2a9cec552daf741bf to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ca8795efc53e47a2a9cec552daf741bf 2023-10-29 15:54:14,999 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/67ea727dade04937945b8710e6ead673 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/67ea727dade04937945b8710e6ead673 2023-10-29 15:54:15,001 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/08985af8c82c42a689f6910975c4f5f0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/08985af8c82c42a689f6910975c4f5f0 2023-10-29 15:54:15,002 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/d63e3396e8824a259a02c2e2d6353ceb to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/d63e3396e8824a259a02c2e2d6353ceb 2023-10-29 15:54:15,003 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/c3eff63a43994d6680271f1f5ffbea07 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/c3eff63a43994d6680271f1f5ffbea07 2023-10-29 15:54:15,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b86b10ab0d04454b90d3005a8b83231c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b86b10ab0d04454b90d3005a8b83231c 2023-10-29 15:54:15,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ea8462617b694b1e86cb5a53c3c8eef1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/ea8462617b694b1e86cb5a53c3c8eef1 2023-10-29 15:54:15,008 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/91db1032b4574a7aba30c17b74fdd447 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/91db1032b4574a7aba30c17b74fdd447 2023-10-29 15:54:15,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/61d3cd1edd3b46409c120892f96e1f65_SeqId_44_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/61d3cd1edd3b46409c120892f96e1f65_SeqId_44_ 2023-10-29 15:54:15,105 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 15:54:15,107 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-10-29 15:54:15,107 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 15:54:15,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-29 15:54:15,115 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, REOPEN/MOVE}] 2023-10-29 15:54:15,116 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, REOPEN/MOVE 2023-10-29 15:54:15,117 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:15,117 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594855117"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594855117"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594855117"}]},"ts":"1698594855117"} 2023-10-29 15:54:15,119 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:15,270 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:15,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0e6ad0e66f54da66125626b190d2f026, disabling compactions & flushes 2023-10-29 15:54:15,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:15,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:15,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. after waiting 0 ms 2023-10-29 15:54:15,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:15,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-29 15:54:15,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:15,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:15,287 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0e6ad0e66f54da66125626b190d2f026 to self. 2023-10-29 15:54:15,289 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,289 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=CLOSED 2023-10-29 15:54:15,289 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594855289"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594855289"}]},"ts":"1698594855289"} 2023-10-29 15:54:15,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=62, resume processing ppid=61 2023-10-29 15:54:15,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651 in 172 msec 2023-10-29 15:54:15,293 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=true 2023-10-29 15:54:15,444 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:15,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594855444"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594855444"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594855444"}]},"ts":"1698594855444"} 2023-10-29 15:54:15,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:15,597 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:15,602 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:15,602 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e6ad0e66f54da66125626b190d2f026, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:54:15,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:15,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,603 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,605 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,607 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:15,607 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:15,607 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e6ad0e66f54da66125626b190d2f026 columnFamilyName family1 2023-10-29 15:54:15,613 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_ 2023-10-29 15:54:15,617 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/81a43f3b0348471aa62d4054e9321940 2023-10-29 15:54:15,620 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b92f17a61611478cb31fc27b8a9eb557 2023-10-29 15:54:15,620 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(310): Store=0e6ad0e66f54da66125626b190d2f026/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:15,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,622 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:15,624 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0e6ad0e66f54da66125626b190d2f026; next sequenceid=50; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71505557, jitterRate=0.06551583111286163}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:54:15,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:15,625 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026., pid=63, masterSystemTime=1698594855597 2023-10-29 15:54:15,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:54:15,626 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 15:54:15,627 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 15:54:15,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:15,627 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1912): 0e6ad0e66f54da66125626b190d2f026/family1 is initiating minor compaction (all files) 2023-10-29 15:54:15,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:15,627 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0e6ad0e66f54da66125626b190d2f026/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:15,628 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/81a43f3b0348471aa62d4054e9321940, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b92f17a61611478cb31fc27b8a9eb557, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp, totalSize=388.1 K 2023-10-29 15:54:15,628 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=OPEN, openSeqNum=50, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:15,628 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594855628"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594855628"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594855628"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594855628"}]},"ts":"1698594855628"} 2023-10-29 15:54:15,628 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 81a43f3b0348471aa62d4054e9321940, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878851783 2023-10-29 15:54:15,628 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting b92f17a61611478cb31fc27b8a9eb557, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621251783 2023-10-29 15:54:15,629 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 335ced49148c465dae450ae3205ced6c_SeqId_46_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=47, earliestPutTs=1448878851783 2023-10-29 15:54:15,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=63, resume processing ppid=61 2023-10-29 15:54:15,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651 in 183 msec 2023-10-29 15:54:15,632 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=60 2023-10-29 15:54:15,633 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, REOPEN/MOVE in 516 msec 2023-10-29 15:54:15,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-10-29 15:54:15,636 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 523 msec 2023-10-29 15:54:15,638 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 943 msec 2023-10-29 15:54:15,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-10-29 15:54:15,640 INFO [Listener at localhost/37167] compactions.TestMobCompactor(278): alter status finished 2023-10-29 15:54:15,641 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:15,642 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:15,643 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:15,644 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:15,644 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595455644 2023-10-29 15:54:15,644 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:54:15,645 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 15:54:15,645 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:15,646 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x4676489e to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:15,647 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0e6ad0e66f54da66125626b190d2f026#family1#compaction#72 average throughput is 19.96 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:15,651 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c2f71aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:15,651 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:15,652 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:15,652 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:15,652 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:15,652 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:15,907 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:54:15,908 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36956343 to 127.0.0.1:62629 2023-10-29 15:54:15,908 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:15,909 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:54:15,909 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x09840a13 to 127.0.0.1:62629 2023-10-29 15:54:15,909 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:15,909 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fd213f1 to 127.0.0.1:62629 2023-10-29 15:54:15,909 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:15,909 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:54:15,909 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a56c3e3 to 127.0.0.1:62629 2023-10-29 15:54:15,909 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:15,910 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:54:15,910 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x429dbdcc to 127.0.0.1:62629 2023-10-29 15:54:15,910 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:16,465 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/.tmp/family1/e7e8bc5c5e0f4c2da3a4a863338d0908 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/e7e8bc5c5e0f4c2da3a4a863338d0908 2023-10-29 15:54:16,469 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 0e6ad0e66f54da66125626b190d2f026/family1 of 0e6ad0e66f54da66125626b190d2f026 into e7e8bc5c5e0f4c2da3a4a863338d0908(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:54:16,469 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:16,469 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026., storeName=0e6ad0e66f54da66125626b190d2f026/family1, priority=13, startTime=1698594855625; duration=0sec 2023-10-29 15:54:16,470 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:54:16,479 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fd6f5aba020849219d7bfd7548c58a0d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128fd6f5aba020849219d7bfd7548c58a0d 2023-10-29 15:54:16,480 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:16,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/81a43f3b0348471aa62d4054e9321940, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b92f17a61611478cb31fc27b8a9eb557, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_] to archive 2023-10-29 15:54:16,489 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:16,491 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/81a43f3b0348471aa62d4054e9321940 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/81a43f3b0348471aa62d4054e9321940 2023-10-29 15:54:16,492 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b92f17a61611478cb31fc27b8a9eb557 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/b92f17a61611478cb31fc27b8a9eb557 2023-10-29 15:54:16,493 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/335ced49148c465dae450ae3205ced6c_SeqId_46_ 2023-10-29 15:54:16,494 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:54:16,495 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:45372, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:54:16,500 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:54:16,502 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:56974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:54:16,511 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1293c4a3c10d4acb806fb531858e31af first=Optional[r05] last=Optional[r8] 2023-10-29 15:54:16,511 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=50 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1293c4a3c10d4acb806fb531858e31af}] 2023-10-29 15:54:16,516 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1293c4a3c10d4acb806fb531858e31af for inclusion in 0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:16,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-10-29 15:54:16,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:54:16,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:16,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1293c4a3c10d4acb806fb531858e31af to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cfmqkmo19abv36gs19idv89kf6m94u5rgk4skl1ohjrbiv9d2j3ng148r12jvhvr/family1/1293c4a3c10d4acb806fb531858e31af 2023-10-29 15:54:16,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cfmqkmo19abv36gs19idv89kf6m94u5rgk4skl1ohjrbiv9d2j3ng148r12jvhvr/family1/1293c4a3c10d4acb806fb531858e31af as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/65f72b69d1cc452aa2440c8b701dda60_SeqId_53_ 2023-10-29 15:54:16,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cfmqkmo19abv36gs19idv89kf6m94u5rgk4skl1ohjrbiv9d2j3ng148r12jvhvr/family1/1293c4a3c10d4acb806fb531858e31af into 0e6ad0e66f54da66125626b190d2f026/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/65f72b69d1cc452aa2440c8b701dda60_SeqId_53_ - updating store file list. 2023-10-29 15:54:16,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/65f72b69d1cc452aa2440c8b701dda60_SeqId_53_ into 0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:16,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cfmqkmo19abv36gs19idv89kf6m94u5rgk4skl1ohjrbiv9d2j3ng148r12jvhvr/family1/1293c4a3c10d4acb806fb531858e31af into 0e6ad0e66f54da66125626b190d2f026/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/65f72b69d1cc452aa2440c8b701dda60_SeqId_53_) 2023-10-29 15:54:16,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__cfmqkmo19abv36gs19idv89kf6m94u5rgk4skl1ohjrbiv9d2j3ng148r12jvhvr/family1/1293c4a3c10d4acb806fb531858e31af 2023-10-29 15:54:16,527 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:16,528 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:16,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511206ccea55fd4724064abeabd4a7a02852e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511206ccea55fd4724064abeabd4a7a02852e 2023-10-29 15:54:16,530 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2d72efc1ac9426c903d877307628cdc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128d2d72efc1ac9426c903d877307628cdc 2023-10-29 15:54:16,530 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-10-29 15:54:16,530 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 15:54:16,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:16,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:16,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:16,530 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:16,530 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:16,531 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:16,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 889 msec 2023-10-29 15:54:16,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$12(2454): Client=jenkins//148.251.75.209 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-10-29 15:54:16,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:17,000 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-29 15:54:17,002 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-10-29 15:54:17,002 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-10-29 15:54:17,007 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-10-29 15:54:17,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, REOPEN/MOVE}] 2023-10-29 15:54:17,012 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, REOPEN/MOVE 2023-10-29 15:54:17,013 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:17,013 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594857013"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594857013"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594857013"}]},"ts":"1698594857013"} 2023-10-29 15:54:17,015 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:17,167 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:17,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0e6ad0e66f54da66125626b190d2f026, disabling compactions & flushes 2023-10-29 15:54:17,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:17,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:17,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. after waiting 0 ms 2023-10-29 15:54:17,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:17,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=49 2023-10-29 15:54:17,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:17,176 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:17,176 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(3510): Not adding moved region record: 0e6ad0e66f54da66125626b190d2f026 to self. 2023-10-29 15:54:17,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,179 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=CLOSED 2023-10-29 15:54:17,179 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594857179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594857179"}]},"ts":"1698594857179"} 2023-10-29 15:54:17,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=67 2023-10-29 15:54:17,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651 in 166 msec 2023-10-29 15:54:17,185 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=true 2023-10-29 15:54:17,335 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:17,336 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594857335"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594857335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594857335"}]},"ts":"1698594857335"} 2023-10-29 15:54:17,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:17,492 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:17,495 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:17,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0e6ad0e66f54da66125626b190d2f026, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:54:17,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:17,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,495 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,497 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,498 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:17,498 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1 2023-10-29 15:54:17,498 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0e6ad0e66f54da66125626b190d2f026 columnFamilyName family1 2023-10-29 15:54:17,504 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/65f72b69d1cc452aa2440c8b701dda60_SeqId_53_ 2023-10-29 15:54:17,507 DEBUG [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/family1/e7e8bc5c5e0f4c2da3a4a863338d0908 2023-10-29 15:54:17,507 INFO [StoreOpener-0e6ad0e66f54da66125626b190d2f026-1] regionserver.HStore(310): Store=0e6ad0e66f54da66125626b190d2f026/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:17,507 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:54:17,511 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0e6ad0e66f54da66125626b190d2f026; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69909985, jitterRate=0.04173995554447174}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:54:17,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:54:17,512 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026., pid=69, masterSystemTime=1698594857492 2023-10-29 15:54:17,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:17,513 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:54:17,513 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=0e6ad0e66f54da66125626b190d2f026, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:17,513 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1698594857513"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594857513"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594857513"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594857513"}]},"ts":"1698594857513"} 2023-10-29 15:54:17,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-10-29 15:54:17,516 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 0e6ad0e66f54da66125626b190d2f026, server=jenkins-hbase20.apache.org,44603,1698594767651 in 175 msec 2023-10-29 15:54:17,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-10-29 15:54:17,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=0e6ad0e66f54da66125626b190d2f026, REOPEN/MOVE in 505 msec 2023-10-29 15:54:17,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=66, resume processing ppid=65 2023-10-29 15:54:17,519 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 511 msec 2023-10-29 15:54:17,520 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 931 msec 2023-10-29 15:54:17,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-10-29 15:54:17,523 INFO [Listener at localhost/37167] compactions.TestMobCompactor(278): alter status finished 2023-10-29 15:54:17,524 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-10-29 15:54:17,525 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:17,525 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:17,526 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:17,526 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595457526 2023-10-29 15:54:17,527 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:54:17,527 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-10-29 15:54:17,527 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:17,529 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x639b65dd to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:17,534 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2cc9c679, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:17,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:17,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:17,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:17,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:17,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:17,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:17,534 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:17,535 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-10-29 15:54:17,535 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-10-29 15:54:17,535 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:17,536 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-10-29 15:54:17,537 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 12 msec 2023-10-29 15:54:17,591 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=238 (was 247), OpenFileDescriptor=606 (was 630), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=167 (was 215), ProcessCount=168 (was 168), AvailableMemoryMB=2732 (was 2771) 2023-10-29 15:54:17,600 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=238, OpenFileDescriptor=606, MaxFileDescriptor=60000, SystemLoadAverage=167, ProcessCount=168, AvailableMemoryMB=2731 2023-10-29 15:54:17,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 15:54:17,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-10-29 15:54:17,606 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:54:17,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-10-29 15:54:17,607 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:54:17,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 15:54:17,608 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:17,608 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c empty. 2023-10-29 15:54:17,609 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:17,609 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-29 15:54:17,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 15:54:17,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 15:54:18,019 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-10-29 15:54:18,023 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => c58b5200e7c7a34995910274f727b35c, NAME => 'testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:54:18,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 15:54:18,434 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:18,434 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing c58b5200e7c7a34995910274f727b35c, disabling compactions & flushes 2023-10-29 15:54:18,434 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:18,434 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:18,434 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. after waiting 0 ms 2023-10-29 15:54:18,434 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:18,434 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:18,435 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for c58b5200e7c7a34995910274f727b35c: 2023-10-29 15:54:18,441 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:54:18,442 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698594858442"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594858442"}]},"ts":"1698594858442"} 2023-10-29 15:54:18,445 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:54:18,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:54:18,446 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594858446"}]},"ts":"1698594858446"} 2023-10-29 15:54:18,448 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-10-29 15:54:18,451 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c58b5200e7c7a34995910274f727b35c, ASSIGN}] 2023-10-29 15:54:18,453 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c58b5200e7c7a34995910274f727b35c, ASSIGN 2023-10-29 15:54:18,453 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=c58b5200e7c7a34995910274f727b35c, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:54:18,604 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c58b5200e7c7a34995910274f727b35c, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:18,605 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698594858604"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594858604"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594858604"}]},"ts":"1698594858604"} 2023-10-29 15:54:18,607 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure c58b5200e7c7a34995910274f727b35c, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:18,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 15:54:18,760 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:18,765 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:18,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c58b5200e7c7a34995910274f727b35c, NAME => 'testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:54:18,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-10-29 15:54:18,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-10-29 15:54:18,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:18,769 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:18,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:18,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:18,772 INFO [StoreOpener-c58b5200e7c7a34995910274f727b35c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:18,775 DEBUG [StoreOpener-c58b5200e7c7a34995910274f727b35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1 2023-10-29 15:54:18,775 DEBUG [StoreOpener-c58b5200e7c7a34995910274f727b35c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1 2023-10-29 15:54:18,775 INFO [StoreOpener-c58b5200e7c7a34995910274f727b35c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c58b5200e7c7a34995910274f727b35c columnFamilyName f1 2023-10-29 15:54:18,778 INFO [StoreOpener-c58b5200e7c7a34995910274f727b35c-1] regionserver.HStore(310): Store=c58b5200e7c7a34995910274f727b35c/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:18,779 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:18,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:18,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:18,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:54:18,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c58b5200e7c7a34995910274f727b35c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73757501, jitterRate=0.0990724116563797}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:54:18,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c58b5200e7c7a34995910274f727b35c: 2023-10-29 15:54:18,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c., pid=73, masterSystemTime=1698594858760 2023-10-29 15:54:18,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:18,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:18,794 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=c58b5200e7c7a34995910274f727b35c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:18,794 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698594858794"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594858794"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594858794"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594858794"}]},"ts":"1698594858794"} 2023-10-29 15:54:18,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=73, resume processing ppid=72 2023-10-29 15:54:18,797 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure c58b5200e7c7a34995910274f727b35c, server=jenkins-hbase20.apache.org,44603,1698594767651 in 189 msec 2023-10-29 15:54:18,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-10-29 15:54:18,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=c58b5200e7c7a34995910274f727b35c, ASSIGN in 346 msec 2023-10-29 15:54:18,799 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:54:18,799 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594858799"}]},"ts":"1698594858799"} 2023-10-29 15:54:18,800 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-10-29 15:54:18,802 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:54:18,803 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1980 sec 2023-10-29 15:54:19,474 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-10-29 15:54:19,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-10-29 15:54:19,719 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-10-29 15:54:19,720 DEBUG [Listener at localhost/37167] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-10-29 15:54:19,724 INFO [Listener at localhost/37167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-29 15:54:19,728 INFO [Listener at localhost/37167] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-10-29 15:54:19,729 INFO [Listener at localhost/37167] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-10-29 15:54:19,729 INFO [Listener at localhost/37167] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-10-29 15:54:19,732 INFO [Listener at localhost/37167] regionserver.HRegion(2745): Flushing c58b5200e7c7a34995910274f727b35c 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-29 15:54:20,148 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029eef3e4ba854f458c9ee0befd5ca371aa to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029eef3e4ba854f458c9ee0befd5ca371aa 2023-10-29 15:54:20,556 INFO [Listener at localhost/37167] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/.tmp/f1/51b9d495523a4bd690ca588172df7eca 2023-10-29 15:54:20,567 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/.tmp/f1/51b9d495523a4bd690ca588172df7eca as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca 2023-10-29 15:54:20,572 INFO [Listener at localhost/37167] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca, entries=1, sequenceid=5, filesize=4.9 K 2023-10-29 15:54:20,573 INFO [Listener at localhost/37167] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for c58b5200e7c7a34995910274f727b35c in 841ms, sequenceid=5, compaction requested=false 2023-10-29 15:54:20,573 DEBUG [Listener at localhost/37167] regionserver.HRegion(2446): Flush status journal for c58b5200e7c7a34995910274f727b35c: 2023-10-29 15:54:20,576 INFO [Listener at localhost/37167] regionserver.HRegion(2745): Flushing c58b5200e7c7a34995910274f727b35c 1/1 column families, dataSize=37 B heapSize=368 B 2023-10-29 15:54:20,827 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:54:20,991 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310293b5a7d8de5254d6fa937cbf95a8a82f6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310293b5a7d8de5254d6fa937cbf95a8a82f6 2023-10-29 15:54:21,400 INFO [Listener at localhost/37167] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/.tmp/f1/f93cffa8746149d2ab05ea928e7514f5 2023-10-29 15:54:21,408 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/.tmp/f1/f93cffa8746149d2ab05ea928e7514f5 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5 2023-10-29 15:54:21,416 INFO [Listener at localhost/37167] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5, entries=1, sequenceid=9, filesize=4.9 K 2023-10-29 15:54:21,417 INFO [Listener at localhost/37167] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for c58b5200e7c7a34995910274f727b35c in 841ms, sequenceid=9, compaction requested=false 2023-10-29 15:54:21,417 DEBUG [Listener at localhost/37167] regionserver.HRegion(2446): Flush status journal for c58b5200e7c7a34995910274f727b35c: 2023-10-29 15:54:21,419 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-10-29 15:54:21,421 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 15:54:21,421 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 15:54:21,422 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:21,422 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595461422 2023-10-29 15:54:21,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 15:54:21,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-10-29 15:54:21,423 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-10-29 15:54:21,424 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x1f1d8375 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:21,429 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d0574e1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:21,429 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testGetAfterCompaction' and column='f1' 2023-10-29 15:54:21,471 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,471 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,522 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,522 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,573 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,573 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,625 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,625 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,677 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,677 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,728 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,729 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,779 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,780 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,830 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,831 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,882 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,882 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,933 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,933 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,985 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:21,985 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,037 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,037 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,090 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,090 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,142 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,142 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,193 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,193 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,243 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,243 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,257 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029304f02e543834f7f874e205d1375a0b3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029304f02e543834f7f874e205d1375a0b3 2023-10-29 15:54:22,258 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testGetAfterCompaction' column='f1' 2023-10-29 15:54:22,272 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:54:22,273 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46050, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:54:22,280 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:54:22,281 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:57012, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:54:22,290 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/645f8a3e0d7b49bfaf90024298a314e1 first=Optional[r1] last=Optional[r2] 2023-10-29 15:54:22,291 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{f1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/645f8a3e0d7b49bfaf90024298a314e1}] 2023-10-29 15:54:22,295 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,295 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,296 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/645f8a3e0d7b49bfaf90024298a314e1 for inclusion in c58b5200e7c7a34995910274f727b35c/f1 2023-10-29 15:54:22,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-10-29 15:54:22,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:54:22,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for c58b5200e7c7a34995910274f727b35c: 2023-10-29 15:54:22,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/f1/645f8a3e0d7b49bfaf90024298a314e1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testGetAfterCompaction__b6odpko9vqm414jfnot492mk0i2bud8uorgvnmhedjkdct8cs3k7lsaplfa585ve/f1/645f8a3e0d7b49bfaf90024298a314e1 2023-10-29 15:54:22,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testGetAfterCompaction__b6odpko9vqm414jfnot492mk0i2bud8uorgvnmhedjkdct8cs3k7lsaplfa585ve/f1/645f8a3e0d7b49bfaf90024298a314e1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_ 2023-10-29 15:54:22,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testGetAfterCompaction__b6odpko9vqm414jfnot492mk0i2bud8uorgvnmhedjkdct8cs3k7lsaplfa585ve/f1/645f8a3e0d7b49bfaf90024298a314e1 into c58b5200e7c7a34995910274f727b35c/f1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_ - updating store file list. 2023-10-29 15:54:22,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_ into c58b5200e7c7a34995910274f727b35c/f1 2023-10-29 15:54:22,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testGetAfterCompaction__b6odpko9vqm414jfnot492mk0i2bud8uorgvnmhedjkdct8cs3k7lsaplfa585ve/f1/645f8a3e0d7b49bfaf90024298a314e1 into c58b5200e7c7a34995910274f727b35c/f1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_) 2023-10-29 15:54:22,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testGetAfterCompaction__b6odpko9vqm414jfnot492mk0i2bud8uorgvnmhedjkdct8cs3k7lsaplfa585ve/f1/645f8a3e0d7b49bfaf90024298a314e1 2023-10-29 15:54:22,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): c58b5200e7c7a34995910274f727b35c/f1 is initiating minor compaction 2023-10-29 15:54:22,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3e74f32a; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 15:54:22,310 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2259): Starting compaction of c58b5200e7c7a34995910274f727b35c/f1 in testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:22,311 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/.tmp, totalSize=10.0 K 2023-10-29 15:54:22,311 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting f93cffa8746149d2ab05ea928e7514f5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 15:54:22,311 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting abef2fe1c5034f7bace152cb3493bb82_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 15:54:22,313 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testGetAfterCompaction' column='f1' 2023-10-29 15:54:22,314 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:22,316 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310293b5a7d8de5254d6fa937cbf95a8a82f6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202310293b5a7d8de5254d6fa937cbf95a8a82f6 2023-10-29 15:54:22,318 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029eef3e4ba854f458c9ee0befd5ca371aa to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029eef3e4ba854f458c9ee0befd5ca371aa 2023-10-29 15:54:22,318 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-10-29 15:54:22,318 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 15:54:22,318 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testGetAfterCompaction' and column='f1' 2023-10-29 15:54:22,318 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-10-29 15:54:22,318 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:54:22,319 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-10-29 15:54:22,320 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 899 msec 2023-10-29 15:54:22,321 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] throttle.PressureAwareThroughputController(145): c58b5200e7c7a34995910274f727b35c#f1#compaction#75 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:22,346 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,346 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,346 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,351 DEBUG [Listener at localhost/37167] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-10-29 15:54:22,357 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46060, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-10-29 15:54:22,357 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44603] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:22,358 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-10-29 15:54:22,358 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-29 15:54:22,358 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44603] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-29 15:54:22,358 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=44603] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. because compaction request was cancelled 2023-10-29 15:54:22,410 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,410 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,410 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,462 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,462 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,462 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,514 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,514 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,514 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,566 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,566 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,567 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,618 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,619 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,619 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,671 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,671 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,671 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,723 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,723 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,723 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,775 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,775 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,775 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,827 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,827 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,827 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,879 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,879 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,879 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,931 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,931 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,932 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,983 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:22,984 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:22,984 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,036 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,036 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:23,036 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,088 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,088 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:23,088 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,140 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,140 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1698594862252; access_time=1698594861442; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-10-29 15:54:23,140 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594861400; access_time=1698594860578; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,151 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/.tmp/f1/edf6072b5b36465791e7573cec898df2 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/edf6072b5b36465791e7573cec898df2 2023-10-29 15:54:23,157 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in c58b5200e7c7a34995910274f727b35c/f1 of c58b5200e7c7a34995910274f727b35c into edf6072b5b36465791e7573cec898df2(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:54:23,157 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for c58b5200e7c7a34995910274f727b35c: 2023-10-29 15:54:23,157 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1698594862310; duration=0sec 2023-10-29 15:54:23,157 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:54:23,183 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_] to archive 2023-10-29 15:54:23,185 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:23,188 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/f93cffa8746149d2ab05ea928e7514f5 2023-10-29 15:54:23,191 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/abef2fe1c5034f7bace152cb3493bb82_SeqId_12_ 2023-10-29 15:54:23,191 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1698594860556; access_time=1698594859735; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,192 INFO [Listener at localhost/37167] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/edf6072b5b36465791e7573cec898df2; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1698594863138; access_time=1698594862318; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-10-29 15:54:23,314 INFO [Listener at localhost/37167] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-10-29 15:54:23,318 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testGetAfterCompaction 2023-10-29 15:54:23,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-10-29 15:54:23,329 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594863329"}]},"ts":"1698594863329"} 2023-10-29 15:54:23,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 15:54:23,330 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-10-29 15:54:23,332 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-10-29 15:54:23,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c58b5200e7c7a34995910274f727b35c, UNASSIGN}] 2023-10-29 15:54:23,334 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=c58b5200e7c7a34995910274f727b35c, UNASSIGN 2023-10-29 15:54:23,335 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c58b5200e7c7a34995910274f727b35c, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:23,335 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698594863335"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594863335"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594863335"}]},"ts":"1698594863335"} 2023-10-29 15:54:23,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure c58b5200e7c7a34995910274f727b35c, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:23,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 15:54:23,488 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:23,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:23,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c58b5200e7c7a34995910274f727b35c, disabling compactions & flushes 2023-10-29 15:54:23,489 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:23,489 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:23,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. after waiting 0 ms 2023-10-29 15:54:23,490 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:23,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-29 15:54:23,502 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-10-29 15:54:23,503 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c. 2023-10-29 15:54:23,504 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c58b5200e7c7a34995910274f727b35c: 2023-10-29 15:54:23,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:23,508 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=c58b5200e7c7a34995910274f727b35c, regionState=CLOSED 2023-10-29 15:54:23,508 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1698594863508"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594863508"}]},"ts":"1698594863508"} 2023-10-29 15:54:23,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-10-29 15:54:23,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure c58b5200e7c7a34995910274f727b35c, server=jenkins-hbase20.apache.org,44603,1698594767651 in 175 msec 2023-10-29 15:54:23,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=75 2023-10-29 15:54:23,516 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=c58b5200e7c7a34995910274f727b35c, UNASSIGN in 181 msec 2023-10-29 15:54:23,516 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594863516"}]},"ts":"1698594863516"} 2023-10-29 15:54:23,518 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-10-29 15:54:23,520 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-10-29 15:54:23,521 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 200 msec 2023-10-29 15:54:23,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-10-29 15:54:23,635 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-10-29 15:54:23,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testGetAfterCompaction 2023-10-29 15:54:23,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 15:54:23,650 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 15:54:23,651 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 15:54:23,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-29 15:54:23,655 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:23,658 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1, FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/recovered.edits] 2023-10-29 15:54:23,662 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/51b9d495523a4bd690ca588172df7eca 2023-10-29 15:54:23,664 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/edf6072b5b36465791e7573cec898df2 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/f1/edf6072b5b36465791e7573cec898df2 2023-10-29 15:54:23,667 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/recovered.edits/15.seqid to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c/recovered.edits/15.seqid 2023-10-29 15:54:23,667 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testGetAfterCompaction/c58b5200e7c7a34995910274f727b35c 2023-10-29 15:54:23,667 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-10-29 15:54:23,667 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-29 15:54:23,668 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-10-29 15:54:23,672 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029304f02e543834f7f874e205d1375a0b3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231029304f02e543834f7f874e205d1375a0b3 2023-10-29 15:54:23,673 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-10-29 15:54:23,676 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 15:54:23,696 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-10-29 15:54:23,698 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-10-29 15:54:23,699 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 15:54:23,699 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-10-29 15:54:23,699 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698594863699"}]},"ts":"9223372036854775807"} 2023-10-29 15:54:23,701 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-10-29 15:54:23,701 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c58b5200e7c7a34995910274f727b35c, NAME => 'testGetAfterCompaction,,1698594857604.c58b5200e7c7a34995910274f727b35c.', STARTKEY => '', ENDKEY => ''}] 2023-10-29 15:54:23,701 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-10-29 15:54:23,701 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1698594863701"}]},"ts":"9223372036854775807"} 2023-10-29 15:54:23,702 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-10-29 15:54:23,703 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-10-29 15:54:23,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 60 msec 2023-10-29 15:54:23,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-10-29 15:54:23,754 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-10-29 15:54:23,774 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=244 (was 238) - Thread LEAK? -, OpenFileDescriptor=612 (was 606) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 167), ProcessCount=168 (was 168), AvailableMemoryMB=2730 (was 2731) 2023-10-29 15:54:23,784 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=244, OpenFileDescriptor=612, MaxFileDescriptor=60000, SystemLoadAverage=154, ProcessCount=168, AvailableMemoryMB=2729 2023-10-29 15:54:23,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 15:54:23,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-10-29 15:54:23,789 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:54:23,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-10-29 15:54:23,789 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:54:23,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 15:54:23,791 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:23,791 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:23,791 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:23,792 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35 empty. 2023-10-29 15:54:23,792 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001 empty. 2023-10-29 15:54:23,792 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6 empty. 2023-10-29 15:54:23,792 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:23,792 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:23,792 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:23,792 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-10-29 15:54:23,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 15:54:24,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 15:54:24,200 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-29 15:54:24,203 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2b71995fd137b23273faaf22b15f18e6, NAME => 'testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:54:24,203 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => b797a02ca671ca72e9ef2c194aacc001, NAME => 'testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:54:24,204 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 456613d6802262e459ba2b88983a6e35, NAME => 'testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:54:24,213 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:24,213 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 2b71995fd137b23273faaf22b15f18e6, disabling compactions & flushes 2023-10-29 15:54:24,213 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:24,213 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:24,213 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. after waiting 0 ms 2023-10-29 15:54:24,213 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:24,213 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:24,213 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:24,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 15:54:24,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:24,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing b797a02ca671ca72e9ef2c194aacc001, disabling compactions & flushes 2023-10-29 15:54:24,614 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:24,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:24,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. after waiting 0 ms 2023-10-29 15:54:24,614 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:24,614 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:24,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:24,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:24,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 456613d6802262e459ba2b88983a6e35, disabling compactions & flushes 2023-10-29 15:54:24,615 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:24,615 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:24,616 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. after waiting 0 ms 2023-10-29 15:54:24,616 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:24,616 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:24,616 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:24,620 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:54:24,622 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594864621"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594864621"}]},"ts":"1698594864621"} 2023-10-29 15:54:24,622 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594864621"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594864621"}]},"ts":"1698594864621"} 2023-10-29 15:54:24,622 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594864621"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594864621"}]},"ts":"1698594864621"} 2023-10-29 15:54:24,625 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 15:54:24,625 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:54:24,625 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594864625"}]},"ts":"1698594864625"} 2023-10-29 15:54:24,627 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-29 15:54:24,631 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, ASSIGN}] 2023-10-29 15:54:24,633 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, ASSIGN 2023-10-29 15:54:24,633 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, ASSIGN 2023-10-29 15:54:24,633 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, ASSIGN 2023-10-29 15:54:24,634 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:54:24,634 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:54:24,634 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:54:24,786 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=456613d6802262e459ba2b88983a6e35, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:24,786 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=b797a02ca671ca72e9ef2c194aacc001, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:24,787 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594864786"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594864786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594864786"}]},"ts":"1698594864786"} 2023-10-29 15:54:24,787 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594864786"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594864786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594864786"}]},"ts":"1698594864786"} 2023-10-29 15:54:24,786 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=2b71995fd137b23273faaf22b15f18e6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:24,787 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594864786"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594864786"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594864786"}]},"ts":"1698594864786"} 2023-10-29 15:54:24,789 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 456613d6802262e459ba2b88983a6e35, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:24,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=84, ppid=82, state=RUNNABLE; OpenRegionProcedure b797a02ca671ca72e9ef2c194aacc001, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:24,793 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=80, state=RUNNABLE; OpenRegionProcedure 2b71995fd137b23273faaf22b15f18e6, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:24,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 15:54:24,944 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:24,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:24,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 456613d6802262e459ba2b88983a6e35, NAME => 'testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 15:54:24,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:24,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:24,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:24,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:24,954 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:24,957 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1 2023-10-29 15:54:24,957 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1 2023-10-29 15:54:24,958 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 456613d6802262e459ba2b88983a6e35 columnFamilyName family1 2023-10-29 15:54:24,960 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(310): Store=456613d6802262e459ba2b88983a6e35/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:24,960 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:24,962 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2 2023-10-29 15:54:24,962 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2 2023-10-29 15:54:24,962 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 456613d6802262e459ba2b88983a6e35 columnFamilyName family2 2023-10-29 15:54:24,964 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(310): Store=456613d6802262e459ba2b88983a6e35/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:24,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:24,965 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:24,966 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:24,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:24,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:54:24,969 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 456613d6802262e459ba2b88983a6e35; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69924306, jitterRate=0.04195335507392883}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:24,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:24,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35., pid=83, masterSystemTime=1698594864944 2023-10-29 15:54:24,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:24,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:24,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:24,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b71995fd137b23273faaf22b15f18e6, NAME => 'testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 15:54:24,971 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=456613d6802262e459ba2b88983a6e35, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:24,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:24,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:24,971 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594864971"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594864971"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594864971"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594864971"}]},"ts":"1698594864971"} 2023-10-29 15:54:24,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:24,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:24,972 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:24,974 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1 2023-10-29 15:54:24,974 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1 2023-10-29 15:54:24,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=83, resume processing ppid=81 2023-10-29 15:54:24,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 456613d6802262e459ba2b88983a6e35, server=jenkins-hbase20.apache.org,44603,1698594767651 in 183 msec 2023-10-29 15:54:24,974 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b71995fd137b23273faaf22b15f18e6 columnFamilyName family1 2023-10-29 15:54:24,975 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, ASSIGN in 344 msec 2023-10-29 15:54:24,975 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(310): Store=2b71995fd137b23273faaf22b15f18e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:24,976 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:24,977 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2 2023-10-29 15:54:24,977 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2 2023-10-29 15:54:24,977 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b71995fd137b23273faaf22b15f18e6 columnFamilyName family2 2023-10-29 15:54:24,978 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(310): Store=2b71995fd137b23273faaf22b15f18e6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:24,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:24,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:24,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:24,982 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:24,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:54:24,984 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2b71995fd137b23273faaf22b15f18e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61455609, jitterRate=-0.08424006402492523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:24,984 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:24,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6., pid=85, masterSystemTime=1698594864944 2023-10-29 15:54:24,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:24,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:24,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:24,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b797a02ca671ca72e9ef2c194aacc001, NAME => 'testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 15:54:24,986 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=2b71995fd137b23273faaf22b15f18e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:24,987 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594864986"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594864986"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594864986"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594864986"}]},"ts":"1698594864986"} 2023-10-29 15:54:24,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:24,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:24,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:24,987 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:24,988 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:24,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=80 2023-10-29 15:54:24,989 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=80, state=SUCCESS; OpenRegionProcedure 2b71995fd137b23273faaf22b15f18e6, server=jenkins-hbase20.apache.org,44603,1698594767651 in 197 msec 2023-10-29 15:54:24,990 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1 2023-10-29 15:54:24,990 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1 2023-10-29 15:54:24,990 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b797a02ca671ca72e9ef2c194aacc001 columnFamilyName family1 2023-10-29 15:54:24,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, ASSIGN in 359 msec 2023-10-29 15:54:24,991 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(310): Store=b797a02ca671ca72e9ef2c194aacc001/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:24,991 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:24,992 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2 2023-10-29 15:54:24,993 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2 2023-10-29 15:54:24,993 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b797a02ca671ca72e9ef2c194aacc001 columnFamilyName family2 2023-10-29 15:54:24,994 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(310): Store=b797a02ca671ca72e9ef2c194aacc001/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:24,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:24,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:24,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:24,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:24,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:54:24,999 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b797a02ca671ca72e9ef2c194aacc001; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69263418, jitterRate=0.03210535645484924}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:24,999 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:25,000 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001., pid=84, masterSystemTime=1698594864944 2023-10-29 15:54:25,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:25,001 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:25,001 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=b797a02ca671ca72e9ef2c194aacc001, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:25,002 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594865001"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594865001"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594865001"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594865001"}]},"ts":"1698594865001"} 2023-10-29 15:54:25,002 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46089] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase20.apache.org,44603,1698594767651, table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-10-29 15:54:25,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=84, resume processing ppid=82 2023-10-29 15:54:25,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, ppid=82, state=SUCCESS; OpenRegionProcedure b797a02ca671ca72e9ef2c194aacc001, server=jenkins-hbase20.apache.org,44603,1698594767651 in 213 msec 2023-10-29 15:54:25,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=79 2023-10-29 15:54:25,006 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, ASSIGN in 373 msec 2023-10-29 15:54:25,006 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:54:25,006 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594865006"}]},"ts":"1698594865006"} 2023-10-29 15:54:25,007 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-29 15:54:25,009 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:54:25,010 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 1.2230 sec 2023-10-29 15:54:25,477 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 15:54:25,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-10-29 15:54:25,900 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-10-29 15:54:25,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:25,912 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:25,913 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:25,915 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:25,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 15:54:25,918 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 15:54:25,918 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:25,918 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 15:54:25,918 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 15:54:25,918 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:25,918 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:25,919 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:25,919 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:25,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:25,919 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:25,919 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:25,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:25,920 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:25,920 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 15:54:25,920 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 15:54:25,920 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 15:54:25,920 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:25,920 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 15:54:25,920 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:25,920 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. started... 2023-10-29 15:54:25,920 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:25,920 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:25,920 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:25,921 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b797a02ca671ca72e9ef2c194aacc001 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:54:25,920 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:25,921 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. started... 2023-10-29 15:54:25,921 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. started... 2023-10-29 15:54:25,921 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 456613d6802262e459ba2b88983a6e35 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:54:25,922 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2b71995fd137b23273faaf22b15f18e6 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:54:25,933 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058 2023-10-29 15:54:25,933 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43 2023-10-29 15:54:25,938 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/a8719b08619d4f00b36e02532a938a3f 2023-10-29 15:54:25,938 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f 2023-10-29 15:54:25,938 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c 2023-10-29 15:54:25,943 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/00ebbe4c51b84172a385e2617756c581 2023-10-29 15:54:25,952 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029eefdca8260d145eaa58dfbbdcaf4beb3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029eefdca8260d145eaa58dfbbdcaf4beb3 2023-10-29 15:54:25,955 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102920f54a60ca554a47bbadb6052442aa88 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102920f54a60ca554a47bbadb6052442aa88 2023-10-29 15:54:26,357 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/16167ff2bd74454e968db8fc36b31f73 2023-10-29 15:54:26,360 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/6911e45244944f6ebfcb6053aea6dcc4 2023-10-29 15:54:26,363 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310291559dade1226424883e6ddcf86904794 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291559dade1226424883e6ddcf86904794 2023-10-29 15:54:26,367 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f 2023-10-29 15:54:26,367 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/00ebbe4c51b84172a385e2617756c581 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/00ebbe4c51b84172a385e2617756c581 2023-10-29 15:54:26,369 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/a0859aaead604b2f8dee52429eea45ba 2023-10-29 15:54:26,371 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/00ebbe4c51b84172a385e2617756c581, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 15:54:26,371 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 15:54:26,372 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/6911e45244944f6ebfcb6053aea6dcc4 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/6911e45244944f6ebfcb6053aea6dcc4 2023-10-29 15:54:26,372 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/16167ff2bd74454e968db8fc36b31f73 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/16167ff2bd74454e968db8fc36b31f73 2023-10-29 15:54:26,373 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/a8719b08619d4f00b36e02532a938a3f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a8719b08619d4f00b36e02532a938a3f 2023-10-29 15:54:26,376 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/6911e45244944f6ebfcb6053aea6dcc4, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:54:26,376 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/16167ff2bd74454e968db8fc36b31f73, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:54:26,376 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a8719b08619d4f00b36e02532a938a3f, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 15:54:26,377 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 456613d6802262e459ba2b88983a6e35 in 456ms, sequenceid=5, compaction requested=false 2023-10-29 15:54:26,377 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 2b71995fd137b23273faaf22b15f18e6 in 455ms, sequenceid=5, compaction requested=false 2023-10-29 15:54:26,377 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:26,377 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:26,377 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:26,377 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:26,377 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/a0859aaead604b2f8dee52429eea45ba as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a0859aaead604b2f8dee52429eea45ba 2023-10-29 15:54:26,377 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:26,377 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:26,381 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a0859aaead604b2f8dee52429eea45ba, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:54:26,382 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for b797a02ca671ca72e9ef2c194aacc001 in 461ms, sequenceid=5, compaction requested=false 2023-10-29 15:54:26,382 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:26,382 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:26,382 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:26,382 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:26,382 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,382 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 15:54:26,382 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 15:54:26,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:26,383 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:26,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:26,384 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:26,384 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:26,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:26,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:26,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:26,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:26,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 15:54:26,385 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f3685a6[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:26,385 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 15:54:26,385 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:26,385 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:26,385 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:26,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:26,386 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 15:54:26,386 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 15:54:26,386 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:26,386 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,386 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:26,386 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 15:54:26,386 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:26,386 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,386 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 15:54:26,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:26,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:26,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:26,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:26,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 15:54:26,389 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 15:54:26,389 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:26,389 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:26,389 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 15:54:26,389 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:26,390 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,390 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:26,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,390 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:26,390 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,390 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:26,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:26,391 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:26,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:26,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:26,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:26,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 15:54:26,392 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:26,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:26,392 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,392 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:26,392 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:26,393 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:26,393 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,393 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:26,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:26,493 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:26,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:26,496 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:26,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:26,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:26,505 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:26,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:26,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 15:54:26,508 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 15:54:26,508 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:26,508 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 15:54:26,508 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 15:54:26,509 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,509 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:26,510 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,510 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:26,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:26,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:26,510 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:26,510 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:26,511 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:26,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:26,511 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 15:54:26,511 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 15:54:26,511 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 15:54:26,511 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 15:54:26,511 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:26,511 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 15:54:26,512 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:26,512 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. started... 2023-10-29 15:54:26,512 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:26,512 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:26,512 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b797a02ca671ca72e9ef2c194aacc001 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:54:26,512 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:26,512 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. started... 2023-10-29 15:54:26,512 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. started... 2023-10-29 15:54:26,512 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 456613d6802262e459ba2b88983a6e35 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:54:26,512 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:26,512 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2b71995fd137b23273faaf22b15f18e6 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:54:26,942 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac 2023-10-29 15:54:26,942 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed 2023-10-29 15:54:26,944 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095 2023-10-29 15:54:27,348 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/547a59bdde0949cb82a7872859135321 2023-10-29 15:54:27,348 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/2cbf42ea71ea49cb98954f10d6b34b4f 2023-10-29 15:54:27,351 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/95d19a7f84e5417d8be0be0af420abd1 2023-10-29 15:54:27,368 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029bfe6e67d2dac45339b71271637ab9878 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029bfe6e67d2dac45339b71271637ab9878 2023-10-29 15:54:27,775 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/354a9229dacc473396864d7e7e43ca87 2023-10-29 15:54:27,776 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029d2f5bdc4f74447ac8245f4e793837046 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d2f5bdc4f74447ac8245f4e793837046 2023-10-29 15:54:27,776 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310294fcc00c4956a414cbd17536ffa6f6b43 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310294fcc00c4956a414cbd17536ffa6f6b43 2023-10-29 15:54:27,781 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/95d19a7f84e5417d8be0be0af420abd1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/95d19a7f84e5417d8be0be0af420abd1 2023-10-29 15:54:27,782 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/c616c72db0954768bb5f370af46f9c8c 2023-10-29 15:54:27,786 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/95d19a7f84e5417d8be0be0af420abd1, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 15:54:27,786 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/547a59bdde0949cb82a7872859135321 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/547a59bdde0949cb82a7872859135321 2023-10-29 15:54:27,786 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/354a9229dacc473396864d7e7e43ca87 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/354a9229dacc473396864d7e7e43ca87 2023-10-29 15:54:27,790 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/547a59bdde0949cb82a7872859135321, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 15:54:27,790 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/354a9229dacc473396864d7e7e43ca87, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:54:27,791 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/c616c72db0954768bb5f370af46f9c8c as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/c616c72db0954768bb5f370af46f9c8c 2023-10-29 15:54:27,791 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 456613d6802262e459ba2b88983a6e35 in 1279ms, sequenceid=9, compaction requested=false 2023-10-29 15:54:27,791 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:27,791 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:27,791 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:27,795 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/c616c72db0954768bb5f370af46f9c8c, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:54:27,796 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for b797a02ca671ca72e9ef2c194aacc001 in 1284ms, sequenceid=9, compaction requested=false 2023-10-29 15:54:27,796 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:27,796 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:27,796 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:28,184 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/abf154bd95e34d5fad5d940cb1145515 2023-10-29 15:54:28,198 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/2cbf42ea71ea49cb98954f10d6b34b4f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/2cbf42ea71ea49cb98954f10d6b34b4f 2023-10-29 15:54:28,205 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/2cbf42ea71ea49cb98954f10d6b34b4f, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 15:54:28,206 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/abf154bd95e34d5fad5d940cb1145515 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/abf154bd95e34d5fad5d940cb1145515 2023-10-29 15:54:28,213 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/abf154bd95e34d5fad5d940cb1145515, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:54:28,214 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 2b71995fd137b23273faaf22b15f18e6 in 1702ms, sequenceid=9, compaction requested=false 2023-10-29 15:54:28,214 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:28,214 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:28,214 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:28,214 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:28,214 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,214 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 15:54:28,214 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 15:54:28,216 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,216 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:28,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:28,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:28,217 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:28,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:28,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:28,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 15:54:28,220 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@28261a6e[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:28,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 15:54:28,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:28,228 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:28,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:28,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:28,229 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 15:54:28,229 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 15:54:28,229 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:28,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,229 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:28,243 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,243 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 15:54:28,244 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:28,244 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 15:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:28,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:28,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:28,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:28,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:28,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:28,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:28,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:28,253 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 15:54:28,253 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 15:54:28,253 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:28,253 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:28,253 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 15:54:28,254 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:28,257 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,257 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,257 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:28,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:28,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:28,258 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:28,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:28,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,260 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:28,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,263 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,263 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:28,263 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:28,263 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:28,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 15:54:28,263 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:28,263 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:28,263 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:28,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:28,264 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:28,264 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:28,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:28,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:28,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:28,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:28,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:28,364 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:28,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:28,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:28,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:28,369 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:28,376 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:28,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:28,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 15:54:28,379 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 15:54:28,380 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:28,380 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 15:54:28,380 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 15:54:28,380 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,380 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:28,381 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,381 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:28,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:28,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:28,381 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:28,381 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:28,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:28,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:28,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:28,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:28,382 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 15:54:28,382 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 15:54:28,382 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 15:54:28,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 15:54:28,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:28,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 15:54:28,383 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:28,383 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:28,383 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:28,383 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. started... 2023-10-29 15:54:28,383 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. started... 2023-10-29 15:54:28,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:28,383 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:28,383 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b797a02ca671ca72e9ef2c194aacc001 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:54:28,383 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2b71995fd137b23273faaf22b15f18e6 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:54:28,383 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. started... 2023-10-29 15:54:28,383 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 456613d6802262e459ba2b88983a6e35 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:54:28,809 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4 2023-10-29 15:54:28,809 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9 2023-10-29 15:54:28,809 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9 2023-10-29 15:54:28,818 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/95fcef1b59594bf49192d9722434203a 2023-10-29 15:54:28,819 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/577cfa53a74943fd8c7937320207ca86 2023-10-29 15:54:28,819 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/89f3328f30c943afb216fcefcb2dfdee 2023-10-29 15:54:29,007 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:54:29,160 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:54:29,160 INFO [regionserver/jenkins-hbase20:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-10-29 15:54:29,160 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f1d8375 to 127.0.0.1:62629 2023-10-29 15:54:29,160 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:29,160 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x639b65dd to 127.0.0.1:62629 2023-10-29 15:54:29,160 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:29,161 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:54:29,161 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4676489e to 127.0.0.1:62629 2023-10-29 15:54:29,161 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:29,242 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029cba64af5db2c41d69a750bd51a600f8f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029cba64af5db2c41d69a750bd51a600f8f 2023-10-29 15:54:29,242 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102900597533c737446eae62822c9df9f71b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102900597533c737446eae62822c9df9f71b 2023-10-29 15:54:29,242 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029ccb07a9a2a8f4aacb0f101aa2c34d3f1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029ccb07a9a2a8f4aacb0f101aa2c34d3f1 2023-10-29 15:54:29,650 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/0efdb82c915f4fb898372149bb81e5ee 2023-10-29 15:54:29,650 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/a29a765d915b4b88b12784e6ccf6fec8 2023-10-29 15:54:29,652 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/9b5dbc115cee4baaae779c69d6fc4786 2023-10-29 15:54:29,660 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/89f3328f30c943afb216fcefcb2dfdee as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/89f3328f30c943afb216fcefcb2dfdee 2023-10-29 15:54:29,660 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/95fcef1b59594bf49192d9722434203a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/95fcef1b59594bf49192d9722434203a 2023-10-29 15:54:29,660 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/577cfa53a74943fd8c7937320207ca86 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/577cfa53a74943fd8c7937320207ca86 2023-10-29 15:54:29,664 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/89f3328f30c943afb216fcefcb2dfdee, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 15:54:29,664 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/577cfa53a74943fd8c7937320207ca86, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 15:54:29,664 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/95fcef1b59594bf49192d9722434203a, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 15:54:29,665 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/a29a765d915b4b88b12784e6ccf6fec8 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/a29a765d915b4b88b12784e6ccf6fec8 2023-10-29 15:54:29,665 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/0efdb82c915f4fb898372149bb81e5ee as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/0efdb82c915f4fb898372149bb81e5ee 2023-10-29 15:54:29,665 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/9b5dbc115cee4baaae779c69d6fc4786 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/9b5dbc115cee4baaae779c69d6fc4786 2023-10-29 15:54:29,669 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/0efdb82c915f4fb898372149bb81e5ee, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:54:29,669 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/a29a765d915b4b88b12784e6ccf6fec8, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:54:29,669 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/9b5dbc115cee4baaae779c69d6fc4786, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:54:29,670 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for b797a02ca671ca72e9ef2c194aacc001 in 1287ms, sequenceid=13, compaction requested=true 2023-10-29 15:54:29,670 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 456613d6802262e459ba2b88983a6e35 in 1287ms, sequenceid=13, compaction requested=true 2023-10-29 15:54:29,670 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:29,670 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 2b71995fd137b23273faaf22b15f18e6 in 1287ms, sequenceid=13, compaction requested=true 2023-10-29 15:54:29,670 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:29,670 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:29,670 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:29,670 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:29,670 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:29,670 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:29,670 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:29,670 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:29,670 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:29,671 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,671 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 15:54:29,671 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 15:54:29,672 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:29,672 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:29,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:29,672 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:29,672 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:29,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:29,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:29,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:29,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:29,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 15:54:29,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c7c3e75[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:29,673 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 15:54:29,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:29,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:29,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:29,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:29,674 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 15:54:29,674 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 15:54:29,674 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:29,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:29,675 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 15:54:29,675 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,675 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:29,675 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 15:54:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:29,677 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 15:54:29,677 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 15:54:29,677 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:29,677 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:29,677 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 15:54:29,677 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:29,677 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,677 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,677 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:29,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:29,678 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:29,679 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:29,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:29,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 15:54:29,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:29,680 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:29,680 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 15:54:29,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:29,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:29,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:29,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:29,681 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,781 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:29,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:29,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:29,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:29,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:29,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:29,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:29,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 15:54:29,795 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 15:54:29,795 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:29,795 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 15:54:29,795 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 15:54:29,796 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,796 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:29,798 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,798 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:29,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:29,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:29,798 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:29,798 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:29,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:29,799 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:29,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:29,799 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 15:54:29,799 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 15:54:29,799 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 15:54:29,799 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 15:54:29,799 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:29,800 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 15:54:29,800 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:29,800 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. started... 2023-10-29 15:54:29,800 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:29,800 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. started... 2023-10-29 15:54:29,800 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:29,800 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:29,800 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:29,800 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 456613d6802262e459ba2b88983a6e35 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:54:29,800 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. started... 2023-10-29 15:54:29,800 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b797a02ca671ca72e9ef2c194aacc001 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:54:29,800 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2b71995fd137b23273faaf22b15f18e6 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:54:29,815 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c 2023-10-29 15:54:30,222 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/070f34c87c8e4e87afd844884e869858 2023-10-29 15:54:30,223 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf 2023-10-29 15:54:30,223 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed 2023-10-29 15:54:30,232 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/e869a30680cc4be98601610bb5a93983 2023-10-29 15:54:30,233 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/55028e7d7a304addae500f20f73df562 2023-10-29 15:54:30,650 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102968454da8f9de499cbd10bec44bb239c0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102968454da8f9de499cbd10bec44bb239c0 2023-10-29 15:54:30,661 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310291adc1eeb80d946f69d2241832792c30a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310291adc1eeb80d946f69d2241832792c30a 2023-10-29 15:54:30,661 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310291daba1cd1b174e15b33473b453bbc154 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310291daba1cd1b174e15b33473b453bbc154 2023-10-29 15:54:31,059 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/47c0a833191548458ff082153b53abee 2023-10-29 15:54:31,067 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/ecfe2edfa10e4d59a92f024e4bdfb6df 2023-10-29 15:54:31,067 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/ec6f57d32d1c4bbab74116512951ee95 2023-10-29 15:54:31,069 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/070f34c87c8e4e87afd844884e869858 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/070f34c87c8e4e87afd844884e869858 2023-10-29 15:54:31,073 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/e869a30680cc4be98601610bb5a93983 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/e869a30680cc4be98601610bb5a93983 2023-10-29 15:54:31,073 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/55028e7d7a304addae500f20f73df562 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/55028e7d7a304addae500f20f73df562 2023-10-29 15:54:31,074 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/070f34c87c8e4e87afd844884e869858, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 15:54:31,074 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/47c0a833191548458ff082153b53abee as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/47c0a833191548458ff082153b53abee 2023-10-29 15:54:31,076 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/e869a30680cc4be98601610bb5a93983, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 15:54:31,076 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/ecfe2edfa10e4d59a92f024e4bdfb6df as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/ecfe2edfa10e4d59a92f024e4bdfb6df 2023-10-29 15:54:31,076 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/55028e7d7a304addae500f20f73df562, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 15:54:31,077 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/ec6f57d32d1c4bbab74116512951ee95 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/ec6f57d32d1c4bbab74116512951ee95 2023-10-29 15:54:31,078 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/47c0a833191548458ff082153b53abee, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:54:31,081 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/ecfe2edfa10e4d59a92f024e4bdfb6df, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:54:31,081 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/ec6f57d32d1c4bbab74116512951ee95, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:54:31,083 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for b797a02ca671ca72e9ef2c194aacc001 in 1282ms, sequenceid=17, compaction requested=true 2023-10-29 15:54:31,083 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 2b71995fd137b23273faaf22b15f18e6 in 1283ms, sequenceid=17, compaction requested=true 2023-10-29 15:54:31,083 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:31,083 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:31,083 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 456613d6802262e459ba2b88983a6e35 in 1282ms, sequenceid=17, compaction requested=true 2023-10-29 15:54:31,083 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:31,083 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:31,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:31,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:31,083 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:31,083 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:31,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:31,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:31,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 15:54:31,083 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 15:54:31,084 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:31,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:31,085 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:31,085 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:31,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:31,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 15:54:31,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@550d7be4[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:31,086 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 15:54:31,086 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:31,087 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:31,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:31,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:31,087 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 15:54:31,087 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 15:54:31,087 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,087 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:31,087 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:31,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 15:54:31,088 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:31,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:31,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:31,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 15:54:31,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:31,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:31,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:31,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:31,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:31,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:31,091 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 15:54:31,091 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:31,091 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:31,091 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 15:54:31,091 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 15:54:31,091 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:31,092 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:31,092 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:31,093 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:31,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:31,093 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:31,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:31,094 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:31,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:31,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:31,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:31,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:31,095 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:31,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:31,095 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:31,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:31,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 15:54:31,095 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:31,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:31,096 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:31,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:31,196 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:31,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:31,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 15:54:31,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698594871209 (current time:1698594871209). 2023-10-29 15:54:31,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-29 15:54:31,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] zookeeper.ReadOnlyZKClient(139): Connect 0x2c7adc7d to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:31,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@611a4078, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:31,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:54:31,223 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:46074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:54:31,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2c7adc7d to 127.0.0.1:62629 2023-10-29 15:54:31,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:31,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-29 15:54:31,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 15:54:31,237 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot, current working dir path: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/snaptb-1698594871197 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-29 15:54:31,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 15:54:31,245 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 15:54:31,246 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698595471246 2023-10-29 15:54:31,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 15:54:31,246 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1698594871197 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-29 15:54:31,247 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 15:54:31,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 15:54:31,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-10-29 15:54:31,249 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 15:54:31,249 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1698595471249 2023-10-29 15:54:31,251 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:31,251 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-29 15:54:31,257 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1698594871197 2023-10-29 15:54:31,259 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1698594871197' 2023-10-29 15:54:31,259 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-29 15:54:31,259 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1698594871197' starting 'acquire' 2023-10-29 15:54:31,259 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1698594871197', kicking off acquire phase on members. 2023-10-29 15:54:31,259 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,259 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1698594871197 2023-10-29 15:54:31,260 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,260 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-29 15:54:31,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-29 15:54:31,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 15:54:31,260 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,260 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:31,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1698594871197 2023-10-29 15:54:31,260 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-10-29 15:54:31,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1698594871197 2023-10-29 15:54:31,261 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1698594871197 from table testCompactionWithHFileLink type FLUSH 2023-10-29 15:54:31,262 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1698594871197 2023-10-29 15:54:31,263 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1698594871197' with timeout 300000ms 2023-10-29 15:54:31,263 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-10-29 15:54:31,263 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1698594871197' starting 'acquire' stage 2023-10-29 15:54:31,263 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1698594871197' locally acquired 2023-10-29 15:54:31,263 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (snaptb-1698594871197) in zk 2023-10-29 15:54:31,264 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1698594871197 2023-10-29 15:54:31,264 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 15:54:31,264 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698594871197 2023-10-29 15:54:31,264 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1698594871197' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:31,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698594871197 2023-10-29 15:54:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:31,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'snaptb-1698594871197' on coordinator 2023-10-29 15:54:31,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e4dcf56[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:31,265 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1698594871197' starting 'in-barrier' execution. 2023-10-29 15:54:31,265 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1698594871197 2023-10-29 15:54:31,266 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698594871197 2023-10-29 15:54:31,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1698594871197 2023-10-29 15:54:31,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1698594871197 2023-10-29 15:54:31,266 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1698594871197' received 'reached' from coordinator. 2023-10-29 15:54:31,266 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,266 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:31,267 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-10-29 15:54:31,267 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. started... 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. started... 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. started... 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:31,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:31,268 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.' region-info for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,268 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.' region-info for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,268 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.' region-info for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,272 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 15:54:31,272 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 15:54:31,272 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-10-29 15:54:31,275 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a8719b08619d4f00b36e02532a938a3f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/547a59bdde0949cb82a7872859135321, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/95fcef1b59594bf49192d9722434203a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/070f34c87c8e4e87afd844884e869858] hfiles 2023-10-29 15:54:31,275 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/95d19a7f84e5417d8be0be0af420abd1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/89f3328f30c943afb216fcefcb2dfdee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/e869a30680cc4be98601610bb5a93983] hfiles 2023-10-29 15:54:31,275 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,275 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/00ebbe4c51b84172a385e2617756c581, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/2cbf42ea71ea49cb98954f10d6b34b4f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/577cfa53a74943fd8c7937320207ca86, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/55028e7d7a304addae500f20f73df562] hfiles 2023-10-29 15:54:31,275 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/00ebbe4c51b84172a385e2617756c581 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,275 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a8719b08619d4f00b36e02532a938a3f for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/95d19a7f84e5417d8be0be0af420abd1 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/89f3328f30c943afb216fcefcb2dfdee for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/e869a30680cc4be98601610bb5a93983 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/2cbf42ea71ea49cb98954f10d6b34b4f for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/577cfa53a74943fd8c7937320207ca86 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/55028e7d7a304addae500f20f73df562 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/547a59bdde0949cb82a7872859135321 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/95fcef1b59594bf49192d9722434203a for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/070f34c87c8e4e87afd844884e869858 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/6911e45244944f6ebfcb6053aea6dcc4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/abf154bd95e34d5fad5d940cb1145515, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/9b5dbc115cee4baaae779c69d6fc4786, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/ec6f57d32d1c4bbab74116512951ee95] hfiles 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/6911e45244944f6ebfcb6053aea6dcc4 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/abf154bd95e34d5fad5d940cb1145515 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/9b5dbc115cee4baaae779c69d6fc4786 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/ec6f57d32d1c4bbab74116512951ee95 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/16167ff2bd74454e968db8fc36b31f73, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/354a9229dacc473396864d7e7e43ca87, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/a29a765d915b4b88b12784e6ccf6fec8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/ecfe2edfa10e4d59a92f024e4bdfb6df] hfiles 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/16167ff2bd74454e968db8fc36b31f73 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/354a9229dacc473396864d7e7e43ca87 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,277 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a0859aaead604b2f8dee52429eea45ba, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/c616c72db0954768bb5f370af46f9c8c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/0efdb82c915f4fb898372149bb81e5ee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/47c0a833191548458ff082153b53abee] hfiles 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/a29a765d915b4b88b12784e6ccf6fec8 for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a0859aaead604b2f8dee52429eea45ba for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/ecfe2edfa10e4d59a92f024e4bdfb6df for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/c616c72db0954768bb5f370af46f9c8c for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/0efdb82c915f4fb898372149bb81e5ee for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,278 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/47c0a833191548458ff082153b53abee for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,352 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:31,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:31,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 15:54:31,356 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-29 15:54:31,556 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:31,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:31,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 15:54:31,560 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-29 15:54:31,685 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. completed. 2023-10-29 15:54:31,685 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:31,685 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. completed. 2023-10-29 15:54:31,685 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:31,686 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. completed. 2023-10-29 15:54:31,686 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:31,686 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-10-29 15:54:31,687 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-10-29 15:54:31,687 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-10-29 15:54:31,687 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-10-29 15:54:31,687 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,687 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1698594871197' locally completed 2023-10-29 15:54:31,687 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1698594871197' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:31,690 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1698594871197' has notified controller of completion 2023-10-29 15:54:31,690 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:31,690 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1698594871197' completed. 2023-10-29 15:54:31,690 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:31,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 15:54:31,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:31,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:31,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698594871197 2023-10-29 15:54:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698594871197 2023-10-29 15:54:31,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1698594871197' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:31,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'snaptb-1698594871197', counting down latch. Waiting for 0 more 2023-10-29 15:54:31,697 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1698594871197' execution completed 2023-10-29 15:54:31,698 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:31,698 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:31,698 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1698594871197 2023-10-29 15:54:31,698 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1698594871197including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-10-29 15:54:31,703 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,703 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-10-29 15:54:31,703 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,703 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-29 15:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:31,704 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-29 15:54:31,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 15:54:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698594871197 2023-10-29 15:54:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698594871197 2023-10-29 15:54:31,706 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1698594871197 2023-10-29 15:54:31,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,712 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,712 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698594871197 2023-10-29 15:54:31,712 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1698594871197 2023-10-29 15:54:31,712 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:31,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1698594871197 2023-10-29 15:54:31,712 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-10-29 15:54:31,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-10-29 15:54:31,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-10-29 15:54:31,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1698594871197 2023-10-29 15:54:31,712 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb-1698594871197 because node does not exist (not an error) 2023-10-29 15:54:31,712 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698594871197/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:31,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-10-29 15:54:31,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-10-29 15:54:31,712 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-10-29 15:54:31,713 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698594871197 2023-10-29 15:54:31,713 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1698594871197 2023-10-29 15:54:31,713 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1698594871197 2023-10-29 15:54:31,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-10-29 15:54:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c] mob files 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac 2023-10-29 15:54:31,715 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9 2023-10-29 15:54:31,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed 2023-10-29 15:54:31,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed 2023-10-29 15:54:31,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c 2023-10-29 15:54:31,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102900597533c737446eae62822c9df9f71b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310291daba1cd1b174e15b33473b453bbc154, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029bfe6e67d2dac45339b71271637ab9878, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029eefdca8260d145eaa58dfbbdcaf4beb3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291559dade1226424883e6ddcf86904794, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310294fcc00c4956a414cbd17536ffa6f6b43, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102968454da8f9de499cbd10bec44bb239c0, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029ccb07a9a2a8f4aacb0f101aa2c34d3f1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310291adc1eeb80d946f69d2241832792c30a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102920f54a60ca554a47bbadb6052442aa88, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029cba64af5db2c41d69a750bd51a600f8f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d2f5bdc4f74447ac8245f4e793837046] mob files 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102900597533c737446eae62822c9df9f71b 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310291daba1cd1b174e15b33473b453bbc154 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029bfe6e67d2dac45339b71271637ab9878 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029eefdca8260d145eaa58dfbbdcaf4beb3 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291559dade1226424883e6ddcf86904794 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310294fcc00c4956a414cbd17536ffa6f6b43 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102968454da8f9de499cbd10bec44bb239c0 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029ccb07a9a2a8f4aacb0f101aa2c34d3f1 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310291adc1eeb80d946f69d2241832792c30a 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102920f54a60ca554a47bbadb6052442aa88 2023-10-29 15:54:31,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029cba64af5db2c41d69a750bd51a600f8f 2023-10-29 15:54:31,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d2f5bdc4f74447ac8245f4e793837046 2023-10-29 15:54:31,860 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:31,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:31,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 15:54:31,862 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-29 15:54:32,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1698594871197 2023-10-29 15:54:32,132 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/snaptb-1698594871197 2023-10-29 15:54:32,362 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:32,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:32,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 15:54:32,365 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-29 15:54:32,580 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/snaptb-1698594871197 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/snaptb-1698594871197 2023-10-29 15:54:32,581 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1698594871197 of table testCompactionWithHFileLink completed 2023-10-29 15:54:32,581 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/snaptb-1698594871197 2023-10-29 15:54:32,582 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/snaptb-1698594871197 2023-10-29 15:54:32,582 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1698594871197 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698594871246Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1698594872127 (+881 ms)Consolidate snapshot: snaptb-1698594871197 at 1698594872127Loading Region manifests for snaptb-1698594871197 at 1698594872127Writing data manifest for snaptb-1698594871197 at 1698594872142 (+15 ms)Verifying snapshot: snaptb-1698594871197 at 1698594872552 (+410 ms)Snapshot snaptb-1698594871197 of table testCompactionWithHFileLink completed at 1698594872581 (+29 ms) 2023-10-29 15:54:32,583 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-10-29 15:54:32,584 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3350 sec 2023-10-29 15:54:33,366 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:33,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:33,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-29 15:54:33,406 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:33,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:33,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-10-29 15:54:33,409 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-10-29 15:54:33,409 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:33,409 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-10-29 15:54:33,409 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-10-29 15:54:33,409 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:33,409 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:33,410 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:33,410 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:33,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:33,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:33,411 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:33,411 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:33,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:33,411 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:33,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:33,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:33,412 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-10-29 15:54:33,412 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-10-29 15:54:33,412 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-10-29 15:54:33,412 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-10-29 15:54:33,412 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:33,412 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-10-29 15:54:33,413 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:33,413 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. started... 2023-10-29 15:54:33,413 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b797a02ca671ca72e9ef2c194aacc001 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:54:33,413 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:33,413 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. started... 2023-10-29 15:54:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:33,413 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:33,414 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. started... 2023-10-29 15:54:33,413 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 456613d6802262e459ba2b88983a6e35 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:54:33,414 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 2b71995fd137b23273faaf22b15f18e6 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:54:33,828 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/d5a719514b9249278cc24e6d4645deed 2023-10-29 15:54:33,835 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5a719514b9249278cc24e6d4645deed 2023-10-29 15:54:33,837 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/a95caedbbd0d459893a75bca89513a97 2023-10-29 15:54:33,841 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a95caedbbd0d459893a75bca89513a97 2023-10-29 15:54:34,238 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/b9c8695509f14722895b9e624a9ffd36 2023-10-29 15:54:34,247 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9c8695509f14722895b9e624a9ffd36 2023-10-29 15:54:34,252 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/5aeb5985743e4bc2a6d54def8443f071 2023-10-29 15:54:34,255 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5aeb5985743e4bc2a6d54def8443f071 2023-10-29 15:54:34,256 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/e70637905a4e47c9b3414ff1950b889a 2023-10-29 15:54:34,256 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/d5a719514b9249278cc24e6d4645deed as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/d5a719514b9249278cc24e6d4645deed 2023-10-29 15:54:34,260 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e70637905a4e47c9b3414ff1950b889a 2023-10-29 15:54:34,261 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d5a719514b9249278cc24e6d4645deed 2023-10-29 15:54:34,261 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/d5a719514b9249278cc24e6d4645deed, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 15:54:34,261 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/a95caedbbd0d459893a75bca89513a97 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a95caedbbd0d459893a75bca89513a97 2023-10-29 15:54:34,261 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/5aeb5985743e4bc2a6d54def8443f071 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/5aeb5985743e4bc2a6d54def8443f071 2023-10-29 15:54:34,266 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a95caedbbd0d459893a75bca89513a97 2023-10-29 15:54:34,266 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a95caedbbd0d459893a75bca89513a97, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 15:54:34,266 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5aeb5985743e4bc2a6d54def8443f071 2023-10-29 15:54:34,266 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/5aeb5985743e4bc2a6d54def8443f071, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 15:54:34,267 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 2b71995fd137b23273faaf22b15f18e6 in 853ms, sequenceid=24, compaction requested=true 2023-10-29 15:54:34,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/e70637905a4e47c9b3414ff1950b889a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/e70637905a4e47c9b3414ff1950b889a 2023-10-29 15:54:34,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:34,267 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:34,267 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:34,272 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e70637905a4e47c9b3414ff1950b889a 2023-10-29 15:54:34,272 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/e70637905a4e47c9b3414ff1950b889a, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 15:54:34,273 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for b797a02ca671ca72e9ef2c194aacc001 in 860ms, sequenceid=24, compaction requested=true 2023-10-29 15:54:34,273 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:34,273 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:34,273 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:35,067 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/f7728ab102ef45a5bbbc17c5f0d03635 2023-10-29 15:54:35,072 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7728ab102ef45a5bbbc17c5f0d03635 2023-10-29 15:54:35,073 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/b9c8695509f14722895b9e624a9ffd36 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b9c8695509f14722895b9e624a9ffd36 2023-10-29 15:54:35,077 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9c8695509f14722895b9e624a9ffd36 2023-10-29 15:54:35,078 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b9c8695509f14722895b9e624a9ffd36, entries=3, sequenceid=24, filesize=5.0 K 2023-10-29 15:54:35,079 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/f7728ab102ef45a5bbbc17c5f0d03635 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/f7728ab102ef45a5bbbc17c5f0d03635 2023-10-29 15:54:35,085 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f7728ab102ef45a5bbbc17c5f0d03635 2023-10-29 15:54:35,085 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/f7728ab102ef45a5bbbc17c5f0d03635, entries=1, sequenceid=24, filesize=5.0 K 2023-10-29 15:54:35,085 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 456613d6802262e459ba2b88983a6e35 in 1672ms, sequenceid=24, compaction requested=true 2023-10-29 15:54:35,086 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:35,086 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:35,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:35,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:35,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-10-29 15:54:35,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-10-29 15:54:35,088 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:35,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:35,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:35,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:35,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-10-29 15:54:35,090 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@16a0419b[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:35,090 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-10-29 15:54:35,090 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:35,090 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:35,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:35,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:35,090 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-10-29 15:54:35,091 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-10-29 15:54:35,091 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:35,091 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,091 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:35,091 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-10-29 15:54:35,091 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:35,091 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,091 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-10-29 15:54:35,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:35,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:35,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:35,094 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-10-29 15:54:35,094 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-10-29 15:54:35,094 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:35,094 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:35,094 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-10-29 15:54:35,094 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:35,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:35,095 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:35,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:35,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:35,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:35,096 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:35,096 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:35,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:35,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:35,097 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-10-29 15:54:35,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:35,099 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:35,099 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:35,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:35,099 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:35,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:35,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-10-29 15:54:35,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:35,099 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,100 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-10-29 15:54:35,100 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:35,100 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:35,100 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:35,100 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-10-29 15:54:35,100 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:35,100 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:35,100 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-10-29 15:54:35,100 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-10-29 15:54:35,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:35,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:35,200 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:35,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:35,202 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:35,202 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): b797a02ca671ca72e9ef2c194aacc001/family1 is initiating major compaction (all files) 2023-10-29 15:54:35,202 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:35,202 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:35,203 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of b797a02ca671ca72e9ef2c194aacc001/family1 in testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:35,203 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a8719b08619d4f00b36e02532a938a3f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/547a59bdde0949cb82a7872859135321, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/95fcef1b59594bf49192d9722434203a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/070f34c87c8e4e87afd844884e869858, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a95caedbbd0d459893a75bca89513a97] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp, totalSize=26.7 K 2023-10-29 15:54:35,204 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting a8719b08619d4f00b36e02532a938a3f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865913 2023-10-29 15:54:35,204 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 547a59bdde0949cb82a7872859135321, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866497 2023-10-29 15:54:35,205 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 95fcef1b59594bf49192d9722434203a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868369 2023-10-29 15:54:35,205 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 070f34c87c8e4e87afd844884e869858, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869786 2023-10-29 15:54:35,205 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting a95caedbbd0d459893a75bca89513a97, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 15:54:35,227 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): b797a02ca671ca72e9ef2c194aacc001#family1#compaction#106 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:35,245 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310290d60b1c8b12b40168fbf6d229b1f4050_del 2023-10-29 15:54:35,246 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310290d60b1c8b12b40168fbf6d229b1f4050_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310290d60b1c8b12b40168fbf6d229b1f4050_del 2023-10-29 15:54:35,283 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40051dc4f8aa4d04b195701b6476d914 2023-10-29 15:54:35,284 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/40051dc4f8aa4d04b195701b6476d914 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/40051dc4f8aa4d04b195701b6476d914 2023-10-29 15:54:35,289 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 40051dc4f8aa4d04b195701b6476d914 2023-10-29 15:54:35,290 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b797a02ca671ca72e9ef2c194aacc001/family1 of b797a02ca671ca72e9ef2c194aacc001 into 40051dc4f8aa4d04b195701b6476d914(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:54:35,290 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:35,290 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:35,290 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): b797a02ca671ca72e9ef2c194aacc001/family2 is initiating major compaction (all files) 2023-10-29 15:54:35,290 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:35,291 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:35,291 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of b797a02ca671ca72e9ef2c194aacc001/family2 in testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:35,291 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a0859aaead604b2f8dee52429eea45ba, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/c616c72db0954768bb5f370af46f9c8c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/0efdb82c915f4fb898372149bb81e5ee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/47c0a833191548458ff082153b53abee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/e70637905a4e47c9b3414ff1950b889a] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp, totalSize=25.4 K 2023-10-29 15:54:35,292 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting a0859aaead604b2f8dee52429eea45ba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865913 2023-10-29 15:54:35,293 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting c616c72db0954768bb5f370af46f9c8c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866497 2023-10-29 15:54:35,293 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 0efdb82c915f4fb898372149bb81e5ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868369 2023-10-29 15:54:35,294 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 47c0a833191548458ff082153b53abee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869786 2023-10-29 15:54:35,297 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting e70637905a4e47c9b3414ff1950b889a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 15:54:35,315 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): b797a02ca671ca72e9ef2c194aacc001#family2#compaction#107 average throughput is 0.26 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:35,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a8719b08619d4f00b36e02532a938a3f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/547a59bdde0949cb82a7872859135321, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/95fcef1b59594bf49192d9722434203a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/070f34c87c8e4e87afd844884e869858, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a95caedbbd0d459893a75bca89513a97] to archive 2023-10-29 15:54:35,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:35,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a8719b08619d4f00b36e02532a938a3f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a8719b08619d4f00b36e02532a938a3f 2023-10-29 15:54:35,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/547a59bdde0949cb82a7872859135321 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/547a59bdde0949cb82a7872859135321 2023-10-29 15:54:35,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/95fcef1b59594bf49192d9722434203a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/95fcef1b59594bf49192d9722434203a 2023-10-29 15:54:35,374 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/070f34c87c8e4e87afd844884e869858 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/070f34c87c8e4e87afd844884e869858 2023-10-29 15:54:35,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a95caedbbd0d459893a75bca89513a97 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/a95caedbbd0d459893a75bca89513a97 2023-10-29 15:54:35,731 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029c9cd550250f8415098eb1ba98f06cce3_del 2023-10-29 15:54:35,732 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029c9cd550250f8415098eb1ba98f06cce3_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029c9cd550250f8415098eb1ba98f06cce3_del 2023-10-29 15:54:36,549 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a74a90a9152a47538a56f22bc4a0652a 2023-10-29 15:54:36,550 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/a74a90a9152a47538a56f22bc4a0652a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a74a90a9152a47538a56f22bc4a0652a 2023-10-29 15:54:36,555 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a74a90a9152a47538a56f22bc4a0652a 2023-10-29 15:54:36,556 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in b797a02ca671ca72e9ef2c194aacc001/family2 of b797a02ca671ca72e9ef2c194aacc001 into a74a90a9152a47538a56f22bc4a0652a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:36,556 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:36,556 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:36,556 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 456613d6802262e459ba2b88983a6e35/family1 is initiating major compaction (all files) 2023-10-29 15:54:36,556 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:36,556 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:36,556 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 456613d6802262e459ba2b88983a6e35/family1 in testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:36,556 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/95d19a7f84e5417d8be0be0af420abd1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/89f3328f30c943afb216fcefcb2dfdee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/e869a30680cc4be98601610bb5a93983, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b9c8695509f14722895b9e624a9ffd36] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp, totalSize=26.7 K 2023-10-29 15:54:36,557 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 1b1e0f20d8d7418aaf7b8e1e06f12c9f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865912 2023-10-29 15:54:36,557 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 95d19a7f84e5417d8be0be0af420abd1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866497 2023-10-29 15:54:36,558 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 89f3328f30c943afb216fcefcb2dfdee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868369 2023-10-29 15:54:36,558 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting e869a30680cc4be98601610bb5a93983, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869785 2023-10-29 15:54:36,558 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting b9c8695509f14722895b9e624a9ffd36, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 15:54:36,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a0859aaead604b2f8dee52429eea45ba, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/c616c72db0954768bb5f370af46f9c8c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/0efdb82c915f4fb898372149bb81e5ee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/47c0a833191548458ff082153b53abee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/e70637905a4e47c9b3414ff1950b889a] to archive 2023-10-29 15:54:36,562 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:36,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a0859aaead604b2f8dee52429eea45ba to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a0859aaead604b2f8dee52429eea45ba 2023-10-29 15:54:36,568 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/c616c72db0954768bb5f370af46f9c8c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/c616c72db0954768bb5f370af46f9c8c 2023-10-29 15:54:36,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/0efdb82c915f4fb898372149bb81e5ee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/0efdb82c915f4fb898372149bb81e5ee 2023-10-29 15:54:36,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/47c0a833191548458ff082153b53abee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/47c0a833191548458ff082153b53abee 2023-10-29 15:54:36,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/e70637905a4e47c9b3414ff1950b889a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/e70637905a4e47c9b3414ff1950b889a 2023-10-29 15:54:36,575 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 456613d6802262e459ba2b88983a6e35#family1#compaction#108 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:36,985 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029ef3cce5b141240eb8dd42070a7d21b75_del 2023-10-29 15:54:36,985 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029ef3cce5b141240eb8dd42070a7d21b75_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ef3cce5b141240eb8dd42070a7d21b75_del 2023-10-29 15:54:37,800 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d20996b0ba6483789de6bc10d9ab55c 2023-10-29 15:54:37,801 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/9d20996b0ba6483789de6bc10d9ab55c as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/9d20996b0ba6483789de6bc10d9ab55c 2023-10-29 15:54:37,806 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9d20996b0ba6483789de6bc10d9ab55c 2023-10-29 15:54:37,807 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 456613d6802262e459ba2b88983a6e35/family1 of 456613d6802262e459ba2b88983a6e35 into 9d20996b0ba6483789de6bc10d9ab55c(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:37,807 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:37,807 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:37,807 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 456613d6802262e459ba2b88983a6e35/family2 is initiating major compaction (all files) 2023-10-29 15:54:37,807 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:37,807 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:37,807 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 456613d6802262e459ba2b88983a6e35/family2 in testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:37,808 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/16167ff2bd74454e968db8fc36b31f73, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/354a9229dacc473396864d7e7e43ca87, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/a29a765d915b4b88b12784e6ccf6fec8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/ecfe2edfa10e4d59a92f024e4bdfb6df, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/f7728ab102ef45a5bbbc17c5f0d03635] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp, totalSize=25.4 K 2023-10-29 15:54:37,808 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 16167ff2bd74454e968db8fc36b31f73, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865912 2023-10-29 15:54:37,809 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 354a9229dacc473396864d7e7e43ca87, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866497 2023-10-29 15:54:37,809 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting a29a765d915b4b88b12784e6ccf6fec8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868369 2023-10-29 15:54:37,809 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting ecfe2edfa10e4d59a92f024e4bdfb6df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869785 2023-10-29 15:54:37,810 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting f7728ab102ef45a5bbbc17c5f0d03635, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 15:54:37,823 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 456613d6802262e459ba2b88983a6e35#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:37,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/95d19a7f84e5417d8be0be0af420abd1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/89f3328f30c943afb216fcefcb2dfdee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/e869a30680cc4be98601610bb5a93983, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b9c8695509f14722895b9e624a9ffd36] to archive 2023-10-29 15:54:37,865 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:37,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/1b1e0f20d8d7418aaf7b8e1e06f12c9f 2023-10-29 15:54:37,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/95d19a7f84e5417d8be0be0af420abd1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/95d19a7f84e5417d8be0be0af420abd1 2023-10-29 15:54:37,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/89f3328f30c943afb216fcefcb2dfdee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/89f3328f30c943afb216fcefcb2dfdee 2023-10-29 15:54:37,871 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/e869a30680cc4be98601610bb5a93983 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/e869a30680cc4be98601610bb5a93983 2023-10-29 15:54:37,873 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b9c8695509f14722895b9e624a9ffd36 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b9c8695509f14722895b9e624a9ffd36 2023-10-29 15:54:38,239 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310290e37efbf8fca4a2383fea9d1a099d917_del 2023-10-29 15:54:38,239 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310290e37efbf8fca4a2383fea9d1a099d917_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310290e37efbf8fca4a2383fea9d1a099d917_del 2023-10-29 15:54:39,072 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3920c1cd777478b8acd58d65bf3715b 2023-10-29 15:54:39,074 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/d3920c1cd777478b8acd58d65bf3715b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/d3920c1cd777478b8acd58d65bf3715b 2023-10-29 15:54:39,077 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3920c1cd777478b8acd58d65bf3715b 2023-10-29 15:54:39,078 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 456613d6802262e459ba2b88983a6e35/family2 of 456613d6802262e459ba2b88983a6e35 into d3920c1cd777478b8acd58d65bf3715b(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:39,078 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:39,078 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:39,079 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 2b71995fd137b23273faaf22b15f18e6/family1 is initiating major compaction (all files) 2023-10-29 15:54:39,079 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:39,079 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:39,079 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 2b71995fd137b23273faaf22b15f18e6/family1 in testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:39,079 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/00ebbe4c51b84172a385e2617756c581, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/2cbf42ea71ea49cb98954f10d6b34b4f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/577cfa53a74943fd8c7937320207ca86, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/55028e7d7a304addae500f20f73df562, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/d5a719514b9249278cc24e6d4645deed] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp, totalSize=26.7 K 2023-10-29 15:54:39,079 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 00ebbe4c51b84172a385e2617756c581, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865911 2023-10-29 15:54:39,080 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 2cbf42ea71ea49cb98954f10d6b34b4f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866496 2023-10-29 15:54:39,080 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 577cfa53a74943fd8c7937320207ca86, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868368 2023-10-29 15:54:39,081 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 55028e7d7a304addae500f20f73df562, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869785 2023-10-29 15:54:39,081 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting d5a719514b9249278cc24e6d4645deed, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 15:54:39,090 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 2b71995fd137b23273faaf22b15f18e6#family1#compaction#110 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:39,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/16167ff2bd74454e968db8fc36b31f73, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/354a9229dacc473396864d7e7e43ca87, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/a29a765d915b4b88b12784e6ccf6fec8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/ecfe2edfa10e4d59a92f024e4bdfb6df, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/f7728ab102ef45a5bbbc17c5f0d03635] to archive 2023-10-29 15:54:39,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:39,170 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/16167ff2bd74454e968db8fc36b31f73 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/16167ff2bd74454e968db8fc36b31f73 2023-10-29 15:54:39,172 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/354a9229dacc473396864d7e7e43ca87 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/354a9229dacc473396864d7e7e43ca87 2023-10-29 15:54:39,174 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/a29a765d915b4b88b12784e6ccf6fec8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/a29a765d915b4b88b12784e6ccf6fec8 2023-10-29 15:54:39,177 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/ecfe2edfa10e4d59a92f024e4bdfb6df to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/ecfe2edfa10e4d59a92f024e4bdfb6df 2023-10-29 15:54:39,179 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/f7728ab102ef45a5bbbc17c5f0d03635 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/f7728ab102ef45a5bbbc17c5f0d03635 2023-10-29 15:54:39,505 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310293ada5605b5144e5b816d5f075803b3b9_del 2023-10-29 15:54:39,505 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310293ada5605b5144e5b816d5f075803b3b9_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293ada5605b5144e5b816d5f075803b3b9_del 2023-10-29 15:54:40,327 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c028a0fab0049bf883d2131a5ec5bc4 2023-10-29 15:54:40,329 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/6c028a0fab0049bf883d2131a5ec5bc4 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/6c028a0fab0049bf883d2131a5ec5bc4 2023-10-29 15:54:40,336 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c028a0fab0049bf883d2131a5ec5bc4 2023-10-29 15:54:40,337 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2b71995fd137b23273faaf22b15f18e6/family1 of 2b71995fd137b23273faaf22b15f18e6 into 6c028a0fab0049bf883d2131a5ec5bc4(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:40,338 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:40,338 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:40,338 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 2b71995fd137b23273faaf22b15f18e6/family2 is initiating major compaction (all files) 2023-10-29 15:54:40,338 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:40,338 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:40,338 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 2b71995fd137b23273faaf22b15f18e6/family2 in testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:40,338 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/6911e45244944f6ebfcb6053aea6dcc4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/abf154bd95e34d5fad5d940cb1145515, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/9b5dbc115cee4baaae779c69d6fc4786, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/ec6f57d32d1c4bbab74116512951ee95, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/5aeb5985743e4bc2a6d54def8443f071] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp, totalSize=25.4 K 2023-10-29 15:54:40,339 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 6911e45244944f6ebfcb6053aea6dcc4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865911 2023-10-29 15:54:40,339 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting abf154bd95e34d5fad5d940cb1145515, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866496 2023-10-29 15:54:40,340 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 9b5dbc115cee4baaae779c69d6fc4786, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868368 2023-10-29 15:54:40,340 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting ec6f57d32d1c4bbab74116512951ee95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869785 2023-10-29 15:54:40,341 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 5aeb5985743e4bc2a6d54def8443f071, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-10-29 15:54:40,354 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 2b71995fd137b23273faaf22b15f18e6#family2#compaction#111 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:40,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/00ebbe4c51b84172a385e2617756c581, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/2cbf42ea71ea49cb98954f10d6b34b4f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/577cfa53a74943fd8c7937320207ca86, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/55028e7d7a304addae500f20f73df562, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/d5a719514b9249278cc24e6d4645deed] to archive 2023-10-29 15:54:40,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:40,363 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/00ebbe4c51b84172a385e2617756c581 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/00ebbe4c51b84172a385e2617756c581 2023-10-29 15:54:40,364 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/2cbf42ea71ea49cb98954f10d6b34b4f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/2cbf42ea71ea49cb98954f10d6b34b4f 2023-10-29 15:54:40,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/577cfa53a74943fd8c7937320207ca86 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/577cfa53a74943fd8c7937320207ca86 2023-10-29 15:54:40,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/55028e7d7a304addae500f20f73df562 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/55028e7d7a304addae500f20f73df562 2023-10-29 15:54:40,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/d5a719514b9249278cc24e6d4645deed to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/d5a719514b9249278cc24e6d4645deed 2023-10-29 15:54:40,768 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023102924e1348f9f1c4bd1ac94b8e2c6a2bf6f_del 2023-10-29 15:54:40,768 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102924e1348f9f1c4bd1ac94b8e2c6a2bf6f_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102924e1348f9f1c4bd1ac94b8e2c6a2bf6f_del 2023-10-29 15:54:41,601 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64e7f32ae44147b1a490ae12ed28884f 2023-10-29 15:54:41,602 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/64e7f32ae44147b1a490ae12ed28884f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/64e7f32ae44147b1a490ae12ed28884f 2023-10-29 15:54:41,609 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64e7f32ae44147b1a490ae12ed28884f 2023-10-29 15:54:41,610 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 2b71995fd137b23273faaf22b15f18e6/family2 of 2b71995fd137b23273faaf22b15f18e6 into 64e7f32ae44147b1a490ae12ed28884f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:41,610 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:41,617 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:41,621 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:41,625 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:41,626 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:41,631 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 15:54:41,663 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-29 15:54:41,666 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202310293ada5605b5144e5b816d5f075803b3b9_del 2023-10-29 15:54:41,669 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029ef3cce5b141240eb8dd42070a7d21b75_del 2023-10-29 15:54:41,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/6911e45244944f6ebfcb6053aea6dcc4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/abf154bd95e34d5fad5d940cb1145515, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/9b5dbc115cee4baaae779c69d6fc4786, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/ec6f57d32d1c4bbab74116512951ee95, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/5aeb5985743e4bc2a6d54def8443f071] to archive 2023-10-29 15:54:41,671 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:41,672 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310290d60b1c8b12b40168fbf6d229b1f4050_del 2023-10-29 15:54:41,672 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/6911e45244944f6ebfcb6053aea6dcc4 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/6911e45244944f6ebfcb6053aea6dcc4 2023-10-29 15:54:41,672 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:41,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/abf154bd95e34d5fad5d940cb1145515 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/abf154bd95e34d5fad5d940cb1145515 2023-10-29 15:54:41,674 DEBUG [Listener at localhost/37167] zookeeper.ReadOnlyZKClient(139): Connect 0x2edae06c to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:41,674 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/9b5dbc115cee4baaae779c69d6fc4786 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/9b5dbc115cee4baaae779c69d6fc4786 2023-10-29 15:54:41,678 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/ec6f57d32d1c4bbab74116512951ee95 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/ec6f57d32d1c4bbab74116512951ee95 2023-10-29 15:54:41,679 DEBUG [Listener at localhost/37167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30b292e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:41,679 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:41,679 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/5aeb5985743e4bc2a6d54def8443f071 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/5aeb5985743e4bc2a6d54def8443f071 2023-10-29 15:54:41,679 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:41,679 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:42,137 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102928ab67f6f27541ef9d98ff596c65b7a6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102928ab67f6f27541ef9d98ff596c65b7a6 2023-10-29 15:54:42,138 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:42,148 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:54:42,151 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:47694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:54:42,158 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:54:42,160 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50802, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:54:42,169 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1fce059e27c84b0aad72d66db6367a93 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-29 15:54:42,169 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1fce059e27c84b0aad72d66db6367a93}] 2023-10-29 15:54:42,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1fce059e27c84b0aad72d66db6367a93 for inclusion in b797a02ca671ca72e9ef2c194aacc001/family1 2023-10-29 15:54:42,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-29 15:54:42,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 15:54:42,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:42,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/1fce059e27c84b0aad72d66db6367a93 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__p8gpf3ugg8f7r4u7rvudoe5bcji0mi1k210c2oc9io4acbi0m9hbi11dm2k79h5t/family1/1fce059e27c84b0aad72d66db6367a93 2023-10-29 15:54:42,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__p8gpf3ugg8f7r4u7rvudoe5bcji0mi1k210c2oc9io4acbi0m9hbi11dm2k79h5t/family1/1fce059e27c84b0aad72d66db6367a93 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/48f0f329896d41e7ac8bcfde216799e9_SeqId_29_ 2023-10-29 15:54:42,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__p8gpf3ugg8f7r4u7rvudoe5bcji0mi1k210c2oc9io4acbi0m9hbi11dm2k79h5t/family1/1fce059e27c84b0aad72d66db6367a93 into b797a02ca671ca72e9ef2c194aacc001/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/48f0f329896d41e7ac8bcfde216799e9_SeqId_29_ - updating store file list. 2023-10-29 15:54:42,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/48f0f329896d41e7ac8bcfde216799e9_SeqId_29_ into b797a02ca671ca72e9ef2c194aacc001/family1 2023-10-29 15:54:42,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__p8gpf3ugg8f7r4u7rvudoe5bcji0mi1k210c2oc9io4acbi0m9hbi11dm2k79h5t/family1/1fce059e27c84b0aad72d66db6367a93 into b797a02ca671ca72e9ef2c194aacc001/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/48f0f329896d41e7ac8bcfde216799e9_SeqId_29_) 2023-10-29 15:54:42,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__p8gpf3ugg8f7r4u7rvudoe5bcji0mi1k210c2oc9io4acbi0m9hbi11dm2k79h5t/family1/1fce059e27c84b0aad72d66db6367a93 2023-10-29 15:54:42,185 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:42,185 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:42,186 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4 2023-10-29 15:54:42,187 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058 2023-10-29 15:54:42,188 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c 2023-10-29 15:54:42,189 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac 2023-10-29 15:54:42,189 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 15:54:42,189 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 15:54:42,189 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:42,547 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310299c371658644d4cf6941faf1c3041c15d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310299c371658644d4cf6941faf1c3041c15d 2023-10-29 15:54:42,547 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310292d99fe7bbf9a4266b529d17f63ae1c91 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310292d99fe7bbf9a4266b529d17f63ae1c91 2023-10-29 15:54:42,549 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:42,549 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:42,572 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/6476deed159a43be8f5dbc9057c3c645 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-29 15:54:42,574 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/6476deed159a43be8f5dbc9057c3c645}] 2023-10-29 15:54:42,574 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/73e13b096fb34c569dbec7e10771f86b first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-29 15:54:42,575 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/73e13b096fb34c569dbec7e10771f86b}] 2023-10-29 15:54:42,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/6476deed159a43be8f5dbc9057c3c645 for inclusion in 456613d6802262e459ba2b88983a6e35/family1 2023-10-29 15:54:42,577 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/73e13b096fb34c569dbec7e10771f86b for inclusion in 2b71995fd137b23273faaf22b15f18e6/family1 2023-10-29 15:54:42,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-29 15:54:42,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 15:54:42,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-29 15:54:42,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 15:54:42,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:42,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:42,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/73e13b096fb34c569dbec7e10771f86b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__vbs2nug5ho7q0hmfr9uaqsihusdj09c6fpvgn495t47usko95s9r5qvb34b84uh6/family1/73e13b096fb34c569dbec7e10771f86b 2023-10-29 15:54:42,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/6476deed159a43be8f5dbc9057c3c645 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__34mpaag3qo6he1nb65guqg9gp0jv2tguf3mccr35ahrc458sg81nvvpjd1qq5tfs/family1/6476deed159a43be8f5dbc9057c3c645 2023-10-29 15:54:42,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__vbs2nug5ho7q0hmfr9uaqsihusdj09c6fpvgn495t47usko95s9r5qvb34b84uh6/family1/73e13b096fb34c569dbec7e10771f86b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/70a0ca521f574fdb853fb706da013ec9_SeqId_29_ 2023-10-29 15:54:42,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__34mpaag3qo6he1nb65guqg9gp0jv2tguf3mccr35ahrc458sg81nvvpjd1qq5tfs/family1/6476deed159a43be8f5dbc9057c3c645 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/6ed9e90db3f04352809f2a6af7057cc2_SeqId_29_ 2023-10-29 15:54:42,584 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__vbs2nug5ho7q0hmfr9uaqsihusdj09c6fpvgn495t47usko95s9r5qvb34b84uh6/family1/73e13b096fb34c569dbec7e10771f86b into 2b71995fd137b23273faaf22b15f18e6/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/70a0ca521f574fdb853fb706da013ec9_SeqId_29_ - updating store file list. 2023-10-29 15:54:42,584 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__34mpaag3qo6he1nb65guqg9gp0jv2tguf3mccr35ahrc458sg81nvvpjd1qq5tfs/family1/6476deed159a43be8f5dbc9057c3c645 into 456613d6802262e459ba2b88983a6e35/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/6ed9e90db3f04352809f2a6af7057cc2_SeqId_29_ - updating store file list. 2023-10-29 15:54:42,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/6ed9e90db3f04352809f2a6af7057cc2_SeqId_29_ into 456613d6802262e459ba2b88983a6e35/family1 2023-10-29 15:54:42,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__34mpaag3qo6he1nb65guqg9gp0jv2tguf3mccr35ahrc458sg81nvvpjd1qq5tfs/family1/6476deed159a43be8f5dbc9057c3c645 into 456613d6802262e459ba2b88983a6e35/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/6ed9e90db3f04352809f2a6af7057cc2_SeqId_29_) 2023-10-29 15:54:42,586 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/70a0ca521f574fdb853fb706da013ec9_SeqId_29_ into 2b71995fd137b23273faaf22b15f18e6/family1 2023-10-29 15:54:42,586 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__vbs2nug5ho7q0hmfr9uaqsihusdj09c6fpvgn495t47usko95s9r5qvb34b84uh6/family1/73e13b096fb34c569dbec7e10771f86b into 2b71995fd137b23273faaf22b15f18e6/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/70a0ca521f574fdb853fb706da013ec9_SeqId_29_) 2023-10-29 15:54:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__34mpaag3qo6he1nb65guqg9gp0jv2tguf3mccr35ahrc458sg81nvvpjd1qq5tfs/family1/6476deed159a43be8f5dbc9057c3c645 2023-10-29 15:54:42,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__vbs2nug5ho7q0hmfr9uaqsihusdj09c6fpvgn495t47usko95s9r5qvb34b84uh6/family1/73e13b096fb34c569dbec7e10771f86b 2023-10-29 15:54:42,588 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:42,588 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:42,589 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:42,589 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:42,590 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9 2023-10-29 15:54:42,590 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43 2023-10-29 15:54:42,591 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed 2023-10-29 15:54:42,591 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf 2023-10-29 15:54:42,591 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed 2023-10-29 15:54:42,591 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9 2023-10-29 15:54:42,592 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c 2023-10-29 15:54:42,592 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 15:54:42,592 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 15:54:42,592 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095 2023-10-29 15:54:42,592 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 15:54:42,592 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 15:54:42,593 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:42,593 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:42,593 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:42,593 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:42,593 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293ada5605b5144e5b816d5f075803b3b9_del] 2023-10-29 15:54:42,593 DEBUG [Listener at localhost/37167] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:42,594 DEBUG [Listener at localhost/37167] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293ada5605b5144e5b816d5f075803b3b9_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310293ada5605b5144e5b816d5f075803b3b9_del 2023-10-29 15:54:42,594 INFO [Listener at localhost/37167] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 15:54:42,595 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ef3cce5b141240eb8dd42070a7d21b75_del] 2023-10-29 15:54:42,595 DEBUG [Listener at localhost/37167] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:42,596 DEBUG [Listener at localhost/37167] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ef3cce5b141240eb8dd42070a7d21b75_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231029ef3cce5b141240eb8dd42070a7d21b75_del 2023-10-29 15:54:42,596 INFO [Listener at localhost/37167] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 15:54:42,596 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310290d60b1c8b12b40168fbf6d229b1f4050_del] 2023-10-29 15:54:42,597 DEBUG [Listener at localhost/37167] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:42,598 DEBUG [Listener at localhost/37167] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310290d60b1c8b12b40168fbf6d229b1f4050_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c202310290d60b1c8b12b40168fbf6d229b1f4050_del 2023-10-29 15:54:42,598 INFO [Listener at localhost/37167] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-10-29 15:54:42,601 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:42,603 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:42,606 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:42,607 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:42,614 INFO [Listener at localhost/37167] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-10-29 15:54:42,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testCompactionWithHFileLink 2023-10-29 15:54:42,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-10-29 15:54:42,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 15:54:42,618 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594882618"}]},"ts":"1698594882618"} 2023-10-29 15:54:42,619 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-10-29 15:54:42,621 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-10-29 15:54:42,621 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, UNASSIGN}] 2023-10-29 15:54:42,623 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, UNASSIGN 2023-10-29 15:54:42,623 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, UNASSIGN 2023-10-29 15:54:42,623 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, UNASSIGN 2023-10-29 15:54:42,624 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=456613d6802262e459ba2b88983a6e35, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:42,624 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b797a02ca671ca72e9ef2c194aacc001, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:42,624 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=2b71995fd137b23273faaf22b15f18e6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:42,624 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594882624"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594882624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594882624"}]},"ts":"1698594882624"} 2023-10-29 15:54:42,624 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594882624"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594882624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594882624"}]},"ts":"1698594882624"} 2023-10-29 15:54:42,624 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594882624"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594882624"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594882624"}]},"ts":"1698594882624"} 2023-10-29 15:54:42,626 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=92, ppid=90, state=RUNNABLE; CloseRegionProcedure 456613d6802262e459ba2b88983a6e35, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:42,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 2b71995fd137b23273faaf22b15f18e6, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:42,628 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; CloseRegionProcedure b797a02ca671ca72e9ef2c194aacc001, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:42,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 15:54:42,778 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:42,779 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:42,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b797a02ca671ca72e9ef2c194aacc001, disabling compactions & flushes 2023-10-29 15:54:42,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:42,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:42,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. after waiting 0 ms 2023-10-29 15:54:42,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:42,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 15:54:42,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:42,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:42,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:42,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:42,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 456613d6802262e459ba2b88983a6e35, disabling compactions & flushes 2023-10-29 15:54:42,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:42,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:42,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. after waiting 0 ms 2023-10-29 15:54:42,791 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:42,791 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=b797a02ca671ca72e9ef2c194aacc001, regionState=CLOSED 2023-10-29 15:54:42,791 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594882791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594882791"}]},"ts":"1698594882791"} 2023-10-29 15:54:42,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-10-29 15:54:42,794 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; CloseRegionProcedure b797a02ca671ca72e9ef2c194aacc001, server=jenkins-hbase20.apache.org,44603,1698594767651 in 166 msec 2023-10-29 15:54:42,796 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 15:54:42,796 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, UNASSIGN in 174 msec 2023-10-29 15:54:42,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:42,797 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:42,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:42,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:42,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2b71995fd137b23273faaf22b15f18e6, disabling compactions & flushes 2023-10-29 15:54:42,798 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:42,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:42,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. after waiting 0 ms 2023-10-29 15:54:42,798 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=456613d6802262e459ba2b88983a6e35, regionState=CLOSED 2023-10-29 15:54:42,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:42,798 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594882798"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594882798"}]},"ts":"1698594882798"} 2023-10-29 15:54:42,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-10-29 15:54:42,802 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; CloseRegionProcedure 456613d6802262e459ba2b88983a6e35, server=jenkins-hbase20.apache.org,44603,1698594767651 in 174 msec 2023-10-29 15:54:42,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, UNASSIGN in 181 msec 2023-10-29 15:54:42,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-10-29 15:54:42,804 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:42,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:42,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:42,806 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=2b71995fd137b23273faaf22b15f18e6, regionState=CLOSED 2023-10-29 15:54:42,806 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594882806"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594882806"}]},"ts":"1698594882806"} 2023-10-29 15:54:42,809 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=89 2023-10-29 15:54:42,809 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 2b71995fd137b23273faaf22b15f18e6, server=jenkins-hbase20.apache.org,44603,1698594767651 in 181 msec 2023-10-29 15:54:42,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=89, resume processing ppid=88 2023-10-29 15:54:42,811 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, UNASSIGN in 188 msec 2023-10-29 15:54:42,811 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594882811"}]},"ts":"1698594882811"} 2023-10-29 15:54:42,812 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-10-29 15:54:42,813 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-10-29 15:54:42,814 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 199 msec 2023-10-29 15:54:42,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-10-29 15:54:42,921 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-10-29 15:54:42,938 INFO [Listener at localhost/37167] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1698594871197-1698594882938 2023-10-29 15:54:42,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 15:54:42,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1698594882939 (current time:1698594882939). 2023-10-29 15:54:42,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-10-29 15:54:42,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] zookeeper.ReadOnlyZKClient(139): Connect 0x663506e4 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:42,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5abd2dbc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:42,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:54:42,946 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:54:42,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x663506e4 to 127.0.0.1:62629 2023-10-29 15:54:42,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:54:42,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-10-29 15:54:42,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 15:54:42,949 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot, current working dir path: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698594871197-1698594882938 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-10-29 15:54:42,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 15:54:42,953 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 15:54:42,953 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1698595482953 2023-10-29 15:54:42,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 15:54:42,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1698594871197-1698594882938 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-10-29 15:54:42,954 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:42,954 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-10-29 15:54:43,054 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:43,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:43,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 15:54:43,056 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-10-29 15:54:43,256 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:43,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:43,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 15:54:43,260 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-10-29 15:54:43,362 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-10-29 15:54:43,364 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 15:54:43,364 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 15:54:43,364 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 15:54:43,365 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 15:54:43,365 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-10-29 15:54:43,364 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 15:54:43,365 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 15:54:43,365 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/6ed9e90db3f04352809f2a6af7057cc2_SeqId_29_, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/9d20996b0ba6483789de6bc10d9ab55c] hfiles 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/6ed9e90db3f04352809f2a6af7057cc2_SeqId_29_ 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/9d20996b0ba6483789de6bc10d9ab55c 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/6c028a0fab0049bf883d2131a5ec5bc4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/70a0ca521f574fdb853fb706da013ec9_SeqId_29_] hfiles 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310299c371658644d4cf6941faf1c3041c15d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102928ab67f6f27541ef9d98ff596c65b7a6, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310292d99fe7bbf9a4266b529d17f63ae1c91] hfiles 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/40051dc4f8aa4d04b195701b6476d914, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/48f0f329896d41e7ac8bcfde216799e9_SeqId_29_] hfiles 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/6c028a0fab0049bf883d2131a5ec5bc4 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/40051dc4f8aa4d04b195701b6476d914 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310299c371658644d4cf6941faf1c3041c15d 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/48f0f329896d41e7ac8bcfde216799e9_SeqId_29_ 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/70a0ca521f574fdb853fb706da013ec9_SeqId_29_ 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102928ab67f6f27541ef9d98ff596c65b7a6 2023-10-29 15:54:43,369 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310292d99fe7bbf9a4266b529d17f63ae1c91 2023-10-29 15:54:43,370 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/d3920c1cd777478b8acd58d65bf3715b] hfiles 2023-10-29 15:54:43,370 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/d3920c1cd777478b8acd58d65bf3715b 2023-10-29 15:54:43,371 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a74a90a9152a47538a56f22bc4a0652a] hfiles 2023-10-29 15:54:43,371 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a74a90a9152a47538a56f22bc4a0652a 2023-10-29 15:54:43,372 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/64e7f32ae44147b1a490ae12ed28884f] hfiles 2023-10-29 15:54:43,373 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/64e7f32ae44147b1a490ae12ed28884f 2023-10-29 15:54:43,375 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102900597533c737446eae62822c9df9f71b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310290e37efbf8fca4a2383fea9d1a099d917_del, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310291daba1cd1b174e15b33473b453bbc154, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029bfe6e67d2dac45339b71271637ab9878, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029eefdca8260d145eaa58dfbbdcaf4beb3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291559dade1226424883e6ddcf86904794, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310294fcc00c4956a414cbd17536ffa6f6b43, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102968454da8f9de499cbd10bec44bb239c0, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029c9cd550250f8415098eb1ba98f06cce3_del, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029ccb07a9a2a8f4aacb0f101aa2c34d3f1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310291adc1eeb80d946f69d2241832792c30a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102920f54a60ca554a47bbadb6052442aa88, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102924e1348f9f1c4bd1ac94b8e2c6a2bf6f_del, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029cba64af5db2c41d69a750bd51a600f8f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d2f5bdc4f74447ac8245f4e793837046] hfiles 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023102900597533c737446eae62822c9df9f71b 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310290e37efbf8fca4a2383fea9d1a099d917_del 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310291daba1cd1b174e15b33473b453bbc154 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029bfe6e67d2dac45339b71271637ab9878 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231029eefdca8260d145eaa58dfbbdcaf4beb3 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310291559dade1226424883e6ddcf86904794 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c202310294fcc00c4956a414cbd17536ffa6f6b43 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023102968454da8f9de499cbd10bec44bb239c0 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029c9cd550250f8415098eb1ba98f06cce3_del 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029ccb07a9a2a8f4aacb0f101aa2c34d3f1 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202310291adc1eeb80d946f69d2241832792c30a 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102920f54a60ca554a47bbadb6052442aa88 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102924e1348f9f1c4bd1ac94b8e2c6a2bf6f_del 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029cba64af5db2c41d69a750bd51a600f8f 2023-10-29 15:54:43,376 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231029d2f5bdc4f74447ac8245f4e793837046 2023-10-29 15:54:43,561 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:43,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:43,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 15:54:43,563 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-10-29 15:54:43,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-10-29 15:54:43,793 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1698594871197-1698594882938 2023-10-29 15:54:43,795 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698594871197-1698594882938 2023-10-29 15:54:44,064 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:44,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:44,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-10-29 15:54:44,067 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-10-29 15:54:44,233 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698594871197-1698594882938 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/hbase-failsafe-snaptb-1698594871197-1698594882938 2023-10-29 15:54:44,234 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1698594871197-1698594882938 of table testCompactionWithHFileLink completed 2023-10-29 15:54:44,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698594871197-1698594882938 2023-10-29 15:54:44,234 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1698594871197-1698594882938 2023-10-29 15:54:44,234 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1698594871197-1698594882938 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1698594882953Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1698594883362 (+409 ms)Consolidate snapshot: hbase-failsafe-snaptb-1698594871197-1698594882938 at 1698594883793 (+431 ms)Loading Region manifests for hbase-failsafe-snaptb-1698594871197-1698594882938 at 1698594883793Writing data manifest for hbase-failsafe-snaptb-1698594871197-1698594882938 at 1698594883802 (+9 ms)Verifying snapshot: hbase-failsafe-snaptb-1698594871197-1698594882938 at 1698594884213 (+411 ms)Snapshot hbase-failsafe-snaptb-1698594871197-1698594882938 of table testCompactionWithHFileLink completed at 1698594884234 (+21 ms) 2023-10-29 15:54:44,235 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-10-29 15:54:44,236 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2840 sec 2023-10-29 15:54:45,067 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-10-29 15:54:45,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-10-29 15:54:45,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1698594871197-1698594882938 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-10-29 15:54:45,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698594871197" table: "testCompactionWithHFileLink" creation_time: 1698594871209 type: FLUSH version: 2 ttl: 0 ) 2023-10-29 15:54:45,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1698594871197 as table=testCompactionWithHFileLink 2023-10-29 15:54:45,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 15:54:45,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 15:54:45,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 15:54:45,530 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-29 15:54:45,533 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-10-29 15:54:45,534 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-10-29 15:54:45,536 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-10-29 15:54:45,543 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1698594871197" table: "testCompactionWithHFileLink" creation_time: 1698594871209 type: FLUSH version: 2 ttl: 0 2023-10-29 15:54:45,543 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink 2023-10-29 15:54:45,550 DEBUG [PEWorker-4] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-10-29 15:54:45,553 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102928ab67f6f27541ef9d98ff596c65b7a6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023102928ab67f6f27541ef9d98ff596c65b7a6 2023-10-29 15:54:45,554 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310299c371658644d4cf6941faf1c3041c15d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202310299c371658644d4cf6941faf1c3041c15d 2023-10-29 15:54:45,555 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310292d99fe7bbf9a4266b529d17f63ae1c91 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202310292d99fe7bbf9a4266b529d17f63ae1c91 2023-10-29 15:54:45,555 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43 of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,558 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,561 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9 of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,563 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095 of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,565 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4 of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,567 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058 of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,569 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,572 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,574 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9 of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,576 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,578 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,580 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c of snapshot=snaptb-1698594871197 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-10-29 15:54:45,585 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102924e1348f9f1c4bd1ac94b8e2c6a2bf6f_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023102924e1348f9f1c4bd1ac94b8e2c6a2bf6f_del 2023-10-29 15:54:45,586 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029c9cd550250f8415098eb1ba98f06cce3_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231029c9cd550250f8415098eb1ba98f06cce3_del 2023-10-29 15:54:45,588 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310290e37efbf8fca4a2383fea9d1a099d917_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202310290e37efbf8fca4a2383fea9d1a099d917_del 2023-10-29 15:54:45,588 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:45,588 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:45,588 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(223): region to restore: b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:45,591 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/6c028a0fab0049bf883d2131a5ec5bc4 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/6c028a0fab0049bf883d2131a5ec5bc4 2023-10-29 15:54:45,591 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/9d20996b0ba6483789de6bc10d9ab55c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/9d20996b0ba6483789de6bc10d9ab55c 2023-10-29 15:54:45,591 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/48f0f329896d41e7ac8bcfde216799e9_SeqId_29_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/48f0f329896d41e7ac8bcfde216799e9_SeqId_29_ 2023-10-29 15:54:45,592 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/70a0ca521f574fdb853fb706da013ec9_SeqId_29_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/70a0ca521f574fdb853fb706da013ec9_SeqId_29_ 2023-10-29 15:54:45,592 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 00ebbe4c51b84172a385e2617756c581 of snapshot=snaptb-1698594871197 to region=2b71995fd137b23273faaf22b15f18e6 table=testCompactionWithHFileLink 2023-10-29 15:54:45,593 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/6ed9e90db3f04352809f2a6af7057cc2_SeqId_29_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/6ed9e90db3f04352809f2a6af7057cc2_SeqId_29_ 2023-10-29 15:54:45,593 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 1b1e0f20d8d7418aaf7b8e1e06f12c9f of snapshot=snaptb-1698594871197 to region=456613d6802262e459ba2b88983a6e35 table=testCompactionWithHFileLink 2023-10-29 15:54:45,593 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/40051dc4f8aa4d04b195701b6476d914 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/40051dc4f8aa4d04b195701b6476d914 2023-10-29 15:54:45,593 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a8719b08619d4f00b36e02532a938a3f of snapshot=snaptb-1698594871197 to region=b797a02ca671ca72e9ef2c194aacc001 table=testCompactionWithHFileLink 2023-10-29 15:54:45,600 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 95d19a7f84e5417d8be0be0af420abd1 of snapshot=snaptb-1698594871197 to region=456613d6802262e459ba2b88983a6e35 table=testCompactionWithHFileLink 2023-10-29 15:54:45,600 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 2cbf42ea71ea49cb98954f10d6b34b4f of snapshot=snaptb-1698594871197 to region=2b71995fd137b23273faaf22b15f18e6 table=testCompactionWithHFileLink 2023-10-29 15:54:45,601 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 547a59bdde0949cb82a7872859135321 of snapshot=snaptb-1698594871197 to region=b797a02ca671ca72e9ef2c194aacc001 table=testCompactionWithHFileLink 2023-10-29 15:54:45,604 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 577cfa53a74943fd8c7937320207ca86 of snapshot=snaptb-1698594871197 to region=2b71995fd137b23273faaf22b15f18e6 table=testCompactionWithHFileLink 2023-10-29 15:54:45,604 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 95fcef1b59594bf49192d9722434203a of snapshot=snaptb-1698594871197 to region=b797a02ca671ca72e9ef2c194aacc001 table=testCompactionWithHFileLink 2023-10-29 15:54:45,604 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 89f3328f30c943afb216fcefcb2dfdee of snapshot=snaptb-1698594871197 to region=456613d6802262e459ba2b88983a6e35 table=testCompactionWithHFileLink 2023-10-29 15:54:45,609 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 55028e7d7a304addae500f20f73df562 of snapshot=snaptb-1698594871197 to region=2b71995fd137b23273faaf22b15f18e6 table=testCompactionWithHFileLink 2023-10-29 15:54:45,610 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 070f34c87c8e4e87afd844884e869858 of snapshot=snaptb-1698594871197 to region=b797a02ca671ca72e9ef2c194aacc001 table=testCompactionWithHFileLink 2023-10-29 15:54:45,610 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e869a30680cc4be98601610bb5a93983 of snapshot=snaptb-1698594871197 to region=456613d6802262e459ba2b88983a6e35 table=testCompactionWithHFileLink 2023-10-29 15:54:45,621 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/d3920c1cd777478b8acd58d65bf3715b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/d3920c1cd777478b8acd58d65bf3715b 2023-10-29 15:54:45,622 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 16167ff2bd74454e968db8fc36b31f73 of snapshot=snaptb-1698594871197 to region=456613d6802262e459ba2b88983a6e35 table=testCompactionWithHFileLink 2023-10-29 15:54:45,625 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/64e7f32ae44147b1a490ae12ed28884f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/64e7f32ae44147b1a490ae12ed28884f 2023-10-29 15:54:45,625 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a74a90a9152a47538a56f22bc4a0652a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/a74a90a9152a47538a56f22bc4a0652a 2023-10-29 15:54:45,625 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 6911e45244944f6ebfcb6053aea6dcc4 of snapshot=snaptb-1698594871197 to region=2b71995fd137b23273faaf22b15f18e6 table=testCompactionWithHFileLink 2023-10-29 15:54:45,625 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a0859aaead604b2f8dee52429eea45ba of snapshot=snaptb-1698594871197 to region=b797a02ca671ca72e9ef2c194aacc001 table=testCompactionWithHFileLink 2023-10-29 15:54:45,625 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 354a9229dacc473396864d7e7e43ca87 of snapshot=snaptb-1698594871197 to region=456613d6802262e459ba2b88983a6e35 table=testCompactionWithHFileLink 2023-10-29 15:54:45,632 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c616c72db0954768bb5f370af46f9c8c of snapshot=snaptb-1698594871197 to region=b797a02ca671ca72e9ef2c194aacc001 table=testCompactionWithHFileLink 2023-10-29 15:54:45,632 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a29a765d915b4b88b12784e6ccf6fec8 of snapshot=snaptb-1698594871197 to region=456613d6802262e459ba2b88983a6e35 table=testCompactionWithHFileLink 2023-10-29 15:54:45,632 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink abf154bd95e34d5fad5d940cb1145515 of snapshot=snaptb-1698594871197 to region=2b71995fd137b23273faaf22b15f18e6 table=testCompactionWithHFileLink 2023-10-29 15:54:45,634 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ecfe2edfa10e4d59a92f024e4bdfb6df of snapshot=snaptb-1698594871197 to region=456613d6802262e459ba2b88983a6e35 table=testCompactionWithHFileLink 2023-10-29 15:54:45,635 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9b5dbc115cee4baaae779c69d6fc4786 of snapshot=snaptb-1698594871197 to region=2b71995fd137b23273faaf22b15f18e6 table=testCompactionWithHFileLink 2023-10-29 15:54:45,635 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 0efdb82c915f4fb898372149bb81e5ee of snapshot=snaptb-1698594871197 to region=b797a02ca671ca72e9ef2c194aacc001 table=testCompactionWithHFileLink 2023-10-29 15:54:45,637 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 47c0a833191548458ff082153b53abee of snapshot=snaptb-1698594871197 to region=b797a02ca671ca72e9ef2c194aacc001 table=testCompactionWithHFileLink 2023-10-29 15:54:45,638 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink ec6f57d32d1c4bbab74116512951ee95 of snapshot=snaptb-1698594871197 to region=2b71995fd137b23273faaf22b15f18e6 table=testCompactionWithHFileLink 2023-10-29 15:54:45,640 INFO [PEWorker-4] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1698594871197" table: "testCompactionWithHFileLink" creation_time: 1698594871209 type: FLUSH version: 2 ttl: 0 2023-10-29 15:54:45,641 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698594885641"}]},"ts":"9223372036854775807"} 2023-10-29 15:54:45,641 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698594885641"}]},"ts":"9223372036854775807"} 2023-10-29 15:54:45,641 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1698594885641"}]},"ts":"9223372036854775807"} 2023-10-29 15:54:45,642 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-10-29 15:54:45,642 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2b71995fd137b23273faaf22b15f18e6, NAME => 'testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 456613d6802262e459ba2b88983a6e35, NAME => 'testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => b797a02ca671ca72e9ef2c194aacc001, NAME => 'testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.', STARTKEY => '2', ENDKEY => ''}] 2023-10-29 15:54:45,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594885642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594885642"}]},"ts":"1698594885642"} 2023-10-29 15:54:45,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594885642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594885642"}]},"ts":"1698594885642"} 2023-10-29 15:54:45,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594885642"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594885642"}]},"ts":"1698594885642"} 2023-10-29 15:54:45,644 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 15:54:45,644 INFO [PEWorker-4] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-10-29 15:54:45,644 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 2b71995fd137b23273faaf22b15f18e6, NAME => 'testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 456613d6802262e459ba2b88983a6e35, NAME => 'testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => b797a02ca671ca72e9ef2c194aacc001, NAME => 'testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.', STARTKEY => '2', ENDKEY => ''}] 2023-10-29 15:54:45,645 INFO [PEWorker-4] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1698594871197 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-10-29 15:54:45,647 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1698594871197" table: "testCompactionWithHFileLink" creation_time: 1698594871209 type: FLUSH version: 2 ttl: 0 ) in 540 msec 2023-10-29 15:54:45,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-10-29 15:54:45,725 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-10-29 15:54:45,726 INFO [Listener at localhost/37167] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1698594871197-1698594882938 2023-10-29 15:54:45,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "hbase-failsafe-snaptb-1698594871197-1698594882938" 2023-10-29 15:54:45,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1698594871197-1698594882938 2023-10-29 15:54:45,738 INFO [Listener at localhost/37167] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-10-29 15:54:45,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$10(2385): Client=jenkins//148.251.75.209 enable testCompactionWithHFileLink 2023-10-29 15:54:45,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-10-29 15:54:45,751 INFO [PEWorker-1] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-10-29 15:54:45,751 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594885751"}]},"ts":"1698594885751"} 2023-10-29 15:54:45,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 15:54:45,752 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-10-29 15:54:45,754 DEBUG [PEWorker-1] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-10-29 15:54:45,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, ASSIGN}] 2023-10-29 15:54:45,755 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, ASSIGN 2023-10-29 15:54:45,755 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, ASSIGN 2023-10-29 15:54:45,755 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, ASSIGN 2023-10-29 15:54:45,756 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 15:54:45,756 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 15:54:45,756 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-10-29 15:54:45,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 15:54:45,909 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b797a02ca671ca72e9ef2c194aacc001, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:45,909 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=2b71995fd137b23273faaf22b15f18e6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:45,909 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594885909"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594885909"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594885909"}]},"ts":"1698594885909"} 2023-10-29 15:54:45,909 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=456613d6802262e459ba2b88983a6e35, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:45,909 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594885909"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594885909"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594885909"}]},"ts":"1698594885909"} 2023-10-29 15:54:45,910 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594885909"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594885909"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594885909"}]},"ts":"1698594885909"} 2023-10-29 15:54:45,913 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure b797a02ca671ca72e9ef2c194aacc001, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:45,914 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=98, state=RUNNABLE; OpenRegionProcedure 2b71995fd137b23273faaf22b15f18e6, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:45,916 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=99, state=RUNNABLE; OpenRegionProcedure 456613d6802262e459ba2b88983a6e35, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:46,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 15:54:46,066 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:46,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:46,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 456613d6802262e459ba2b88983a6e35, NAME => 'testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 15:54:46,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:46,070 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:46,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:46,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:46,072 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:46,074 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1 2023-10-29 15:54:46,074 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1 2023-10-29 15:54:46,074 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 456613d6802262e459ba2b88983a6e35 columnFamilyName family1 2023-10-29 15:54:46,090 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-1b1e0f20d8d7418aaf7b8e1e06f12c9f 2023-10-29 15:54:46,098 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-89f3328f30c943afb216fcefcb2dfdee 2023-10-29 15:54:46,104 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-95d19a7f84e5417d8be0be0af420abd1 2023-10-29 15:54:46,110 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-e869a30680cc4be98601610bb5a93983 2023-10-29 15:54:46,110 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(310): Store=456613d6802262e459ba2b88983a6e35/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:46,111 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:46,112 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2 2023-10-29 15:54:46,112 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2 2023-10-29 15:54:46,112 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 456613d6802262e459ba2b88983a6e35 columnFamilyName family2 2023-10-29 15:54:46,122 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-16167ff2bd74454e968db8fc36b31f73 2023-10-29 15:54:46,129 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-354a9229dacc473396864d7e7e43ca87 2023-10-29 15:54:46,135 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-a29a765d915b4b88b12784e6ccf6fec8 2023-10-29 15:54:46,142 DEBUG [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-ecfe2edfa10e4d59a92f024e4bdfb6df 2023-10-29 15:54:46,142 INFO [StoreOpener-456613d6802262e459ba2b88983a6e35-1] regionserver.HStore(310): Store=456613d6802262e459ba2b88983a6e35/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:46,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:46,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:46,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:46,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 456613d6802262e459ba2b88983a6e35 2023-10-29 15:54:46,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 456613d6802262e459ba2b88983a6e35; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68151152, jitterRate=0.015531301498413086}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:46,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:46,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35., pid=103, masterSystemTime=1698594886066 2023-10-29 15:54:46,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:54:46,153 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 15:54:46,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 15:54:46,153 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 15:54:46,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:46,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:46,155 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:46,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b797a02ca671ca72e9ef2c194aacc001, NAME => 'testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 15:54:46,155 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=456613d6802262e459ba2b88983a6e35, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:46,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:46,156 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594886155"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594886155"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594886155"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594886155"}]},"ts":"1698594886155"} 2023-10-29 15:54:46,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:46,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:46,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:46,158 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 15:54:46,158 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1912): 456613d6802262e459ba2b88983a6e35/family1 is initiating minor compaction (all files) 2023-10-29 15:54:46,158 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 456613d6802262e459ba2b88983a6e35/family1 in testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:46,158 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-1b1e0f20d8d7418aaf7b8e1e06f12c9f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-95d19a7f84e5417d8be0be0af420abd1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-89f3328f30c943afb216fcefcb2dfdee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-e869a30680cc4be98601610bb5a93983] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp, totalSize=21.6 K 2023-10-29 15:54:46,158 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 15:54:46,159 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1912): 456613d6802262e459ba2b88983a6e35/family2 is initiating minor compaction (all files) 2023-10-29 15:54:46,159 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 456613d6802262e459ba2b88983a6e35/family2 in testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:54:46,159 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:46,159 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-16167ff2bd74454e968db8fc36b31f73, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-354a9229dacc473396864d7e7e43ca87, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-a29a765d915b4b88b12784e6ccf6fec8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-ecfe2edfa10e4d59a92f024e4bdfb6df] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp, totalSize=20.4 K 2023-10-29 15:54:46,160 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-1b1e0f20d8d7418aaf7b8e1e06f12c9f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865912 2023-10-29 15:54:46,161 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-16167ff2bd74454e968db8fc36b31f73, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865912 2023-10-29 15:54:46,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=99 2023-10-29 15:54:46,161 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=99, state=SUCCESS; OpenRegionProcedure 456613d6802262e459ba2b88983a6e35, server=jenkins-hbase20.apache.org,44603,1698594767651 in 242 msec 2023-10-29 15:54:46,161 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1 2023-10-29 15:54:46,161 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1 2023-10-29 15:54:46,161 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-95d19a7f84e5417d8be0be0af420abd1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866497 2023-10-29 15:54:46,161 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b797a02ca671ca72e9ef2c194aacc001 columnFamilyName family1 2023-10-29 15:54:46,162 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-354a9229dacc473396864d7e7e43ca87, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866497 2023-10-29 15:54:46,162 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=456613d6802262e459ba2b88983a6e35, ASSIGN in 407 msec 2023-10-29 15:54:46,165 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-89f3328f30c943afb216fcefcb2dfdee, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868369 2023-10-29 15:54:46,166 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-a29a765d915b4b88b12784e6ccf6fec8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868369 2023-10-29 15:54:46,166 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-e869a30680cc4be98601610bb5a93983, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869785 2023-10-29 15:54:46,166 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-ecfe2edfa10e4d59a92f024e4bdfb6df, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869785 2023-10-29 15:54:46,177 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-070f34c87c8e4e87afd844884e869858 2023-10-29 15:54:46,188 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-547a59bdde0949cb82a7872859135321 2023-10-29 15:54:46,202 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-95fcef1b59594bf49192d9722434203a 2023-10-29 15:54:46,209 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a8719b08619d4f00b36e02532a938a3f 2023-10-29 15:54:46,212 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(310): Store=b797a02ca671ca72e9ef2c194aacc001/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:46,212 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 456613d6802262e459ba2b88983a6e35#family2#compaction#112 average throughput is 0.12 MB/second, slept 0 time(s) and total slept time is 0 ms. 1 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:46,212 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] throttle.PressureAwareThroughputController(145): 456613d6802262e459ba2b88983a6e35#family1#compaction#113 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:46,213 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:46,213 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2 2023-10-29 15:54:46,213 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2 2023-10-29 15:54:46,214 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b797a02ca671ca72e9ef2c194aacc001 columnFamilyName family2 2023-10-29 15:54:46,223 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-0efdb82c915f4fb898372149bb81e5ee 2023-10-29 15:54:46,227 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-47c0a833191548458ff082153b53abee 2023-10-29 15:54:46,232 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a0859aaead604b2f8dee52429eea45ba 2023-10-29 15:54:46,237 DEBUG [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-c616c72db0954768bb5f370af46f9c8c 2023-10-29 15:54:46,237 INFO [StoreOpener-b797a02ca671ca72e9ef2c194aacc001-1] regionserver.HStore(310): Store=b797a02ca671ca72e9ef2c194aacc001/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:46,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:46,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:46,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:46,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:54:46,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b797a02ca671ca72e9ef2c194aacc001; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74648565, jitterRate=0.11235029995441437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:46,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:46,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001., pid=101, masterSystemTime=1698594886066 2023-10-29 15:54:46,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 15:54:46,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-29 15:54:46,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:46,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:46,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:46,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b71995fd137b23273faaf22b15f18e6, NAME => 'testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 15:54:46,244 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=b797a02ca671ca72e9ef2c194aacc001, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:46,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:46,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:46,244 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594886244"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594886244"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594886244"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594886244"}]},"ts":"1698594886244"} 2023-10-29 15:54:46,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:46,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:46,245 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:46,246 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1 2023-10-29 15:54:46,246 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1 2023-10-29 15:54:46,246 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=100 2023-10-29 15:54:46,247 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b71995fd137b23273faaf22b15f18e6 columnFamilyName family1 2023-10-29 15:54:46,247 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure b797a02ca671ca72e9ef2c194aacc001, server=jenkins-hbase20.apache.org,44603,1698594767651 in 333 msec 2023-10-29 15:54:46,247 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=b797a02ca671ca72e9ef2c194aacc001, ASSIGN in 493 msec 2023-10-29 15:54:46,254 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-00ebbe4c51b84172a385e2617756c581 2023-10-29 15:54:46,260 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-2cbf42ea71ea49cb98954f10d6b34b4f 2023-10-29 15:54:46,265 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-55028e7d7a304addae500f20f73df562 2023-10-29 15:54:46,272 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-577cfa53a74943fd8c7937320207ca86 2023-10-29 15:54:46,272 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(310): Store=2b71995fd137b23273faaf22b15f18e6/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:46,272 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:46,273 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2 2023-10-29 15:54:46,273 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2 2023-10-29 15:54:46,274 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b71995fd137b23273faaf22b15f18e6 columnFamilyName family2 2023-10-29 15:54:46,284 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-6911e45244944f6ebfcb6053aea6dcc4 2023-10-29 15:54:46,290 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-9b5dbc115cee4baaae779c69d6fc4786 2023-10-29 15:54:46,298 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-abf154bd95e34d5fad5d940cb1145515 2023-10-29 15:54:46,305 DEBUG [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(539): loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-ec6f57d32d1c4bbab74116512951ee95 2023-10-29 15:54:46,306 INFO [StoreOpener-2b71995fd137b23273faaf22b15f18e6-1] regionserver.HStore(310): Store=2b71995fd137b23273faaf22b15f18e6/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:46,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:46,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:46,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:46,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:54:46,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2b71995fd137b23273faaf22b15f18e6; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61991742, jitterRate=-0.0762510597705841}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:46,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:46,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6., pid=102, masterSystemTime=1698594886066 2023-10-29 15:54:46,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-29 15:54:46,310 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-29 15:54:46,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:46,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:46,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=2b71995fd137b23273faaf22b15f18e6, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:46,312 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1698594886311"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594886311"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594886311"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594886311"}]},"ts":"1698594886311"} 2023-10-29 15:54:46,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=98 2023-10-29 15:54:46,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=98, state=SUCCESS; OpenRegionProcedure 2b71995fd137b23273faaf22b15f18e6, server=jenkins-hbase20.apache.org,44603,1698594767651 in 399 msec 2023-10-29 15:54:46,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=98, resume processing ppid=97 2023-10-29 15:54:46,315 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=2b71995fd137b23273faaf22b15f18e6, ASSIGN in 560 msec 2023-10-29 15:54:46,315 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594886315"}]},"ts":"1698594886315"} 2023-10-29 15:54:46,316 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-10-29 15:54:46,317 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-10-29 15:54:46,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 574 msec 2023-10-29 15:54:46,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-10-29 15:54:46,357 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-10-29 15:54:46,378 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:46,394 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:46,403 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:46,404 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:46,410 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 15:54:46,426 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-10-29 15:54:46,426 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:46,427 DEBUG [Listener at localhost/37167] zookeeper.ReadOnlyZKClient(139): Connect 0x035cd9e1 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:54:46,431 DEBUG [Listener at localhost/37167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35d1b97d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:54:46,431 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:46,431 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:46,431 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:46,921 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029b6ae842726954188b1f40d1d08e66fa2 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231029b6ae842726954188b1f40d1d08e66fa2 2023-10-29 15:54:46,922 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:46,934 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:54:46,936 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42320, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:54:46,942 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:54:46,945 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51278, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:54:46,962 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/d8e559fc34ee4219902e8d5f6ed87fe8 first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-10-29 15:54:46,962 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/d8e559fc34ee4219902e8d5f6ed87fe8}] 2023-10-29 15:54:46,968 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/d8e559fc34ee4219902e8d5f6ed87fe8 for inclusion in b797a02ca671ca72e9ef2c194aacc001/family1 2023-10-29 15:54:46,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-10-29 15:54:46,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 15:54:46,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:46,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029/family1/d8e559fc34ee4219902e8d5f6ed87fe8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__fnls5ct9p5i64lag9j6dh5m5qaf0cq265u1lsnbpt16001a75beaighdokiu6je7/family1/d8e559fc34ee4219902e8d5f6ed87fe8 2023-10-29 15:54:46,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__fnls5ct9p5i64lag9j6dh5m5qaf0cq265u1lsnbpt16001a75beaighdokiu6je7/family1/d8e559fc34ee4219902e8d5f6ed87fe8 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_ 2023-10-29 15:54:46,973 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__fnls5ct9p5i64lag9j6dh5m5qaf0cq265u1lsnbpt16001a75beaighdokiu6je7/family1/d8e559fc34ee4219902e8d5f6ed87fe8 into b797a02ca671ca72e9ef2c194aacc001/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_ - updating store file list. 2023-10-29 15:54:46,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_ into b797a02ca671ca72e9ef2c194aacc001/family1 2023-10-29 15:54:46,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__fnls5ct9p5i64lag9j6dh5m5qaf0cq265u1lsnbpt16001a75beaighdokiu6je7/family1/d8e559fc34ee4219902e8d5f6ed87fe8 into b797a02ca671ca72e9ef2c194aacc001/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_) 2023-10-29 15:54:46,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__fnls5ct9p5i64lag9j6dh5m5qaf0cq265u1lsnbpt16001a75beaighdokiu6je7/family1/d8e559fc34ee4219902e8d5f6ed87fe8 2023-10-29 15:54:46,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:46,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-29 15:54:46,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): b797a02ca671ca72e9ef2c194aacc001/family1 is initiating minor compaction (all files) 2023-10-29 15:54:46,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@177d95ba; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-29 15:54:46,980 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:46,980 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:46,982 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310291f291dacd8aa4dce9aec89d818c3a4a4 2023-10-29 15:54:46,982 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310294cc756e097a1476f9cd3e2872d8cf058 2023-10-29 15:54:46,983 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c202310295a07c9255d324d90992286138937067c 2023-10-29 15:54:46,984 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231029881258f52ed3458e84efecf8baad9bac 2023-10-29 15:54:46,984 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 15:54:46,984 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 15:54:46,984 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:47,037 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family2/0eeeb4798b0742ab8442a310031a95ed as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/0eeeb4798b0742ab8442a310031a95ed 2023-10-29 15:54:47,043 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-10-29 15:54:47,044 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 456613d6802262e459ba2b88983a6e35/family2 of 456613d6802262e459ba2b88983a6e35 into 0eeeb4798b0742ab8442a310031a95ed(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:54:47,044 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:47,044 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35., storeName=456613d6802262e459ba2b88983a6e35/family2, priority=12, startTime=1698594886153; duration=0sec 2023-10-29 15:54:47,044 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-29 15:54:47,044 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b797a02ca671ca72e9ef2c194aacc001/family1 in testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:47,044 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a8719b08619d4f00b36e02532a938a3f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-547a59bdde0949cb82a7872859135321, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-95fcef1b59594bf49192d9722434203a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-070f34c87c8e4e87afd844884e869858, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp, totalSize=28.9 K 2023-10-29 15:54:47,046 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a8719b08619d4f00b36e02532a938a3f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865913 2023-10-29 15:54:47,046 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-547a59bdde0949cb82a7872859135321, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866497 2023-10-29 15:54:47,047 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-95fcef1b59594bf49192d9722434203a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868369 2023-10-29 15:54:47,048 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-070f34c87c8e4e87afd844884e869858, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869786 2023-10-29 15:54:47,048 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698594865913 2023-10-29 15:54:47,067 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): b797a02ca671ca72e9ef2c194aacc001#family1#compaction#114 average throughput is 0.78 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:47,068 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-16167ff2bd74454e968db8fc36b31f73, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-354a9229dacc473396864d7e7e43ca87, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-a29a765d915b4b88b12784e6ccf6fec8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-ecfe2edfa10e4d59a92f024e4bdfb6df] to archive 2023-10-29 15:54:47,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:47,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-16167ff2bd74454e968db8fc36b31f73 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-16167ff2bd74454e968db8fc36b31f73 2023-10-29 15:54:47,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-354a9229dacc473396864d7e7e43ca87 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-354a9229dacc473396864d7e7e43ca87 2023-10-29 15:54:47,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-a29a765d915b4b88b12784e6ccf6fec8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-a29a765d915b4b88b12784e6ccf6fec8 2023-10-29 15:54:47,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-ecfe2edfa10e4d59a92f024e4bdfb6df to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family2/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-ecfe2edfa10e4d59a92f024e4bdfb6df 2023-10-29 15:54:47,321 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102939f36956b5054dc5b9260b1d9ade149e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023102939f36956b5054dc5b9260b1d9ade149e 2023-10-29 15:54:47,324 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:47,330 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102954ca8ead31994710a65d636b29568a45 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b2023102954ca8ead31994710a65d636b29568a45 2023-10-29 15:54:47,331 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:47,358 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/0657f19cef8e4698bbfd802ea4e200c3 first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-10-29 15:54:47,359 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=32 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/0657f19cef8e4698bbfd802ea4e200c3}] 2023-10-29 15:54:47,360 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/cbd5dcdc08594f7fa85608ec98832b99 first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-10-29 15:54:47,360 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/cbd5dcdc08594f7fa85608ec98832b99}] 2023-10-29 15:54:47,362 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/0657f19cef8e4698bbfd802ea4e200c3 for inclusion in 2b71995fd137b23273faaf22b15f18e6/family1 2023-10-29 15:54:47,362 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/cbd5dcdc08594f7fa85608ec98832b99 for inclusion in 456613d6802262e459ba2b88983a6e35/family1 2023-10-29 15:54:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-10-29 15:54:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-10-29 15:54:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 15:54:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 15:54:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:47,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:47,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029/family1/cbd5dcdc08594f7fa85608ec98832b99 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__1b6cunn98f36ak9n8t0v982l8evl2ddkkisctq972v9sacmnoqauljvi99hrb5ne/family1/cbd5dcdc08594f7fa85608ec98832b99 2023-10-29 15:54:47,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029/family1/0657f19cef8e4698bbfd802ea4e200c3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__c80htrcohgqns571n7ero3hsoouvn3s3pj0ni9rh379a34istvqdoqdiarv6gr9f/family1/0657f19cef8e4698bbfd802ea4e200c3 2023-10-29 15:54:47,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__1b6cunn98f36ak9n8t0v982l8evl2ddkkisctq972v9sacmnoqauljvi99hrb5ne/family1/cbd5dcdc08594f7fa85608ec98832b99 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b559614ecae5493e9985d7aa7db0fc0f_SeqId_35_ 2023-10-29 15:54:47,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__c80htrcohgqns571n7ero3hsoouvn3s3pj0ni9rh379a34istvqdoqdiarv6gr9f/family1/0657f19cef8e4698bbfd802ea4e200c3 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/dc83e96b966c48b3a03738740a385b03_SeqId_34_ 2023-10-29 15:54:47,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__1b6cunn98f36ak9n8t0v982l8evl2ddkkisctq972v9sacmnoqauljvi99hrb5ne/family1/cbd5dcdc08594f7fa85608ec98832b99 into 456613d6802262e459ba2b88983a6e35/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b559614ecae5493e9985d7aa7db0fc0f_SeqId_35_ - updating store file list. 2023-10-29 15:54:47,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__c80htrcohgqns571n7ero3hsoouvn3s3pj0ni9rh379a34istvqdoqdiarv6gr9f/family1/0657f19cef8e4698bbfd802ea4e200c3 into 2b71995fd137b23273faaf22b15f18e6/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/dc83e96b966c48b3a03738740a385b03_SeqId_34_ - updating store file list. 2023-10-29 15:54:47,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b559614ecae5493e9985d7aa7db0fc0f_SeqId_35_ into 456613d6802262e459ba2b88983a6e35/family1 2023-10-29 15:54:47,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/dc83e96b966c48b3a03738740a385b03_SeqId_34_ into 2b71995fd137b23273faaf22b15f18e6/family1 2023-10-29 15:54:47,372 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__1b6cunn98f36ak9n8t0v982l8evl2ddkkisctq972v9sacmnoqauljvi99hrb5ne/family1/cbd5dcdc08594f7fa85608ec98832b99 into 456613d6802262e459ba2b88983a6e35/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/b559614ecae5493e9985d7aa7db0fc0f_SeqId_35_) 2023-10-29 15:54:47,372 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__c80htrcohgqns571n7ero3hsoouvn3s3pj0ni9rh379a34istvqdoqdiarv6gr9f/family1/0657f19cef8e4698bbfd802ea4e200c3 into 2b71995fd137b23273faaf22b15f18e6/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/dc83e96b966c48b3a03738740a385b03_SeqId_34_) 2023-10-29 15:54:47,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__1b6cunn98f36ak9n8t0v982l8evl2ddkkisctq972v9sacmnoqauljvi99hrb5ne/family1/cbd5dcdc08594f7fa85608ec98832b99 2023-10-29 15:54:47,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testCompactionWithHFileLink__c80htrcohgqns571n7ero3hsoouvn3s3pj0ni9rh379a34istvqdoqdiarv6gr9f/family1/0657f19cef8e4698bbfd802ea4e200c3 2023-10-29 15:54:47,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:47,375 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:47,376 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:47,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-10-29 15:54:47,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(1912): 2b71995fd137b23273faaf22b15f18e6/family1 is initiating minor compaction (all files) 2023-10-29 15:54:47,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1a9917bc; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-29 15:54:47,377 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310292576830920bc4e509d8852541c2c8a43 2023-10-29 15:54:47,378 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:47,378 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b202310297cd79f1a94ae4b1c97456747a497beaf 2023-10-29 15:54:47,378 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:47,379 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029ab7073e6025145c8aa58263416f63be9 2023-10-29 15:54:47,379 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310290b5cf878d0c8422aa6c91269c6a38bd9 2023-10-29 15:54:47,380 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231029ad62c40f7e3c4595b700b154756c9095 2023-10-29 15:54:47,380 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 15:54:47,380 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 15:54:47,380 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:47,380 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202310291677bb22dcf343f0b8c918abed40f1ed 2023-10-29 15:54:47,381 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e2023102986775549c8c64b4a91a017dff09461ed 2023-10-29 15:54:47,382 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231029f6ce44e633254821bc835d4896105c0c 2023-10-29 15:54:47,382 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-10-29 15:54:47,382 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 15:54:47,382 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testCompactionWithHFileLink' and column='family1' 2023-10-29 15:54:47,382 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-10-29 15:54:47,384 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:47,387 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:47,389 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:47,390 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:47,396 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:47,397 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:47,411 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=289 (was 244) - Thread LEAK? -, OpenFileDescriptor=759 (was 612) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 154) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 168), AvailableMemoryMB=2640 (was 2729) 2023-10-29 15:54:47,421 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=289, OpenFileDescriptor=759, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=167, AvailableMemoryMB=2640 2023-10-29 15:54:47,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$15(3014): Client=jenkins//148.251.75.209 creating {NAME => 'ns'} 2023-10-29 15:54:47,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-10-29 15:54:47,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-29 15:54:47,432 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-10-29 15:54:47,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 6 msec 2023-10-29 15:54:47,435 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/.tmp/family1/69d330b98f1f4ed7a8230c6bd558e424 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/69d330b98f1f4ed7a8230c6bd558e424 2023-10-29 15:54:47,441 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 456613d6802262e459ba2b88983a6e35/family1 of 456613d6802262e459ba2b88983a6e35 into 69d330b98f1f4ed7a8230c6bd558e424(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:47,441 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:54:47,441 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35., storeName=456613d6802262e459ba2b88983a6e35/family1, priority=12, startTime=1698594886152; duration=1sec 2023-10-29 15:54:47,441 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-10-29 15:54:47,441 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 2b71995fd137b23273faaf22b15f18e6/family1 in testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:47,441 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-00ebbe4c51b84172a385e2617756c581, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-2cbf42ea71ea49cb98954f10d6b34b4f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-577cfa53a74943fd8c7937320207ca86, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-55028e7d7a304addae500f20f73df562, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/dc83e96b966c48b3a03738740a385b03_SeqId_34_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp, totalSize=28.9 K 2023-10-29 15:54:47,442 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-00ebbe4c51b84172a385e2617756c581, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865911 2023-10-29 15:54:47,443 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-2cbf42ea71ea49cb98954f10d6b34b4f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866496 2023-10-29 15:54:47,443 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-577cfa53a74943fd8c7937320207ca86, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868368 2023-10-29 15:54:47,444 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-55028e7d7a304addae500f20f73df562, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869785 2023-10-29 15:54:47,444 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting dc83e96b966c48b3a03738740a385b03_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1698594865911 2023-10-29 15:54:47,454 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] throttle.PressureAwareThroughputController(145): 2b71995fd137b23273faaf22b15f18e6#family1#compaction#115 average throughput is 2.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:47,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-1b1e0f20d8d7418aaf7b8e1e06f12c9f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-95d19a7f84e5417d8be0be0af420abd1, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-89f3328f30c943afb216fcefcb2dfdee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-e869a30680cc4be98601610bb5a93983] to archive 2023-10-29 15:54:47,461 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:47,463 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-1b1e0f20d8d7418aaf7b8e1e06f12c9f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-1b1e0f20d8d7418aaf7b8e1e06f12c9f 2023-10-29 15:54:47,464 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-95d19a7f84e5417d8be0be0af420abd1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-95d19a7f84e5417d8be0be0af420abd1 2023-10-29 15:54:47,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-89f3328f30c943afb216fcefcb2dfdee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-89f3328f30c943afb216fcefcb2dfdee 2023-10-29 15:54:47,467 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-e869a30680cc4be98601610bb5a93983 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/family1/testCompactionWithHFileLink=456613d6802262e459ba2b88983a6e35-e869a30680cc4be98601610bb5a93983 2023-10-29 15:54:47,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-10-29 15:54:47,536 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 15:54:47,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-10-29 15:54:47,541 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:54:47,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-10-29 15:54:47,542 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:54:47,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 15:54:47,545 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:47,545 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:47,545 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:47,546 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46 empty. 2023-10-29 15:54:47,546 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202 empty. 2023-10-29 15:54:47,546 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058 empty. 2023-10-29 15:54:47,546 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:47,546 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:47,547 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:47,547 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-10-29 15:54:47,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 15:54:47,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 15:54:47,957 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-10-29 15:54:47,958 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3572db5871b549a818fbe28bd8653d46, NAME => 'ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:54:47,959 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => 99df69438d2ae3350f006d99e0fba202, NAME => 'ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:54:47,959 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7fae007a80bb8183f2e1263b83980058, NAME => 'ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:54:48,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 15:54:48,293 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family1/e8825a7f0d76418e893863259602d8bb as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/e8825a7f0d76418e893863259602d8bb 2023-10-29 15:54:48,303 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in b797a02ca671ca72e9ef2c194aacc001/family1 of b797a02ca671ca72e9ef2c194aacc001 into e8825a7f0d76418e893863259602d8bb(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:48,303 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:48,303 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698594886978; duration=1sec 2023-10-29 15:54:48,303 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-10-29 15:54:48,303 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 15:54:48,306 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 15:54:48,307 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1912): 2b71995fd137b23273faaf22b15f18e6/family2 is initiating minor compaction (all files) 2023-10-29 15:54:48,307 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 2b71995fd137b23273faaf22b15f18e6/family2 in testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:54:48,307 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-6911e45244944f6ebfcb6053aea6dcc4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-abf154bd95e34d5fad5d940cb1145515, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-9b5dbc115cee4baaae779c69d6fc4786, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-ec6f57d32d1c4bbab74116512951ee95] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp, totalSize=20.4 K 2023-10-29 15:54:48,308 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-6911e45244944f6ebfcb6053aea6dcc4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865911 2023-10-29 15:54:48,309 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-abf154bd95e34d5fad5d940cb1145515, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866496 2023-10-29 15:54:48,309 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-9b5dbc115cee4baaae779c69d6fc4786, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868368 2023-10-29 15:54:48,310 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-ec6f57d32d1c4bbab74116512951ee95, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869785 2023-10-29 15:54:48,323 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:54:48,329 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): 2b71995fd137b23273faaf22b15f18e6#family2#compaction#116 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:48,366 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a8719b08619d4f00b36e02532a938a3f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-547a59bdde0949cb82a7872859135321, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-95fcef1b59594bf49192d9722434203a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-070f34c87c8e4e87afd844884e869858, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_] to archive 2023-10-29 15:54:48,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:48,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a8719b08619d4f00b36e02532a938a3f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a8719b08619d4f00b36e02532a938a3f 2023-10-29 15:54:48,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:48,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 3572db5871b549a818fbe28bd8653d46, disabling compactions & flushes 2023-10-29 15:54:48,369 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:48,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:48,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. after waiting 0 ms 2023-10-29 15:54:48,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:48,369 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:48,369 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:54:48,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-547a59bdde0949cb82a7872859135321 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-547a59bdde0949cb82a7872859135321 2023-10-29 15:54:48,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-95fcef1b59594bf49192d9722434203a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-95fcef1b59594bf49192d9722434203a 2023-10-29 15:54:48,373 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-070f34c87c8e4e87afd844884e869858 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-070f34c87c8e4e87afd844884e869858 2023-10-29 15:54:48,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family1/2eec337de2904ed1bc9a2a14ce398abe_SeqId_34_ 2023-10-29 15:54:48,375 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:48,375 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing 7fae007a80bb8183f2e1263b83980058, disabling compactions & flushes 2023-10-29 15:54:48,375 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:48,375 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. after waiting 0 ms 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:48,376 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing 99df69438d2ae3350f006d99e0fba202, disabling compactions & flushes 2023-10-29 15:54:48,376 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. after waiting 0 ms 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:48,376 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:48,376 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:48,378 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:54:48,379 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698594888379"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594888379"}]},"ts":"1698594888379"} 2023-10-29 15:54:48,380 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698594888379"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594888379"}]},"ts":"1698594888379"} 2023-10-29 15:54:48,380 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698594888379"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594888379"}]},"ts":"1698594888379"} 2023-10-29 15:54:48,381 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 15:54:48,382 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:54:48,382 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594888382"}]},"ts":"1698594888382"} 2023-10-29 15:54:48,384 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-10-29 15:54:48,387 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3572db5871b549a818fbe28bd8653d46, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7fae007a80bb8183f2e1263b83980058, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=99df69438d2ae3350f006d99e0fba202, ASSIGN}] 2023-10-29 15:54:48,389 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7fae007a80bb8183f2e1263b83980058, ASSIGN 2023-10-29 15:54:48,389 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3572db5871b549a818fbe28bd8653d46, ASSIGN 2023-10-29 15:54:48,389 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=99df69438d2ae3350f006d99e0fba202, ASSIGN 2023-10-29 15:54:48,389 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7fae007a80bb8183f2e1263b83980058, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:54:48,390 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3572db5871b549a818fbe28bd8653d46, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:54:48,390 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=99df69438d2ae3350f006d99e0fba202, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:54:48,544 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3572db5871b549a818fbe28bd8653d46, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:48,544 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=99df69438d2ae3350f006d99e0fba202, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:48,544 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7fae007a80bb8183f2e1263b83980058, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:48,545 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698594888544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594888544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594888544"}]},"ts":"1698594888544"} 2023-10-29 15:54:48,545 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698594888544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594888544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594888544"}]},"ts":"1698594888544"} 2023-10-29 15:54:48,545 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698594888544"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594888544"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594888544"}]},"ts":"1698594888544"} 2023-10-29 15:54:48,548 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 3572db5871b549a818fbe28bd8653d46, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:48,549 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=110, ppid=108, state=RUNNABLE; OpenRegionProcedure 99df69438d2ae3350f006d99e0fba202, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:48,549 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=111, ppid=107, state=RUNNABLE; OpenRegionProcedure 7fae007a80bb8183f2e1263b83980058, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:54:48,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 15:54:48,681 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family1/a1f5829d1a37460a8c935939e594c966 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/a1f5829d1a37460a8c935939e594c966 2023-10-29 15:54:48,688 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 2b71995fd137b23273faaf22b15f18e6/family1 of 2b71995fd137b23273faaf22b15f18e6 into a1f5829d1a37460a8c935939e594c966(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:48,688 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:48,688 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1698594887376; duration=1sec 2023-10-29 15:54:48,689 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-10-29 15:54:48,689 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-10-29 15:54:48,692 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-10-29 15:54:48,693 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1912): b797a02ca671ca72e9ef2c194aacc001/family2 is initiating minor compaction (all files) 2023-10-29 15:54:48,693 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b797a02ca671ca72e9ef2c194aacc001/family2 in testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:54:48,693 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a0859aaead604b2f8dee52429eea45ba, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-c616c72db0954768bb5f370af46f9c8c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-0efdb82c915f4fb898372149bb81e5ee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-47c0a833191548458ff082153b53abee] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp, totalSize=20.4 K 2023-10-29 15:54:48,694 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a0859aaead604b2f8dee52429eea45ba, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594865913 2023-10-29 15:54:48,694 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-c616c72db0954768bb5f370af46f9c8c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594866497 2023-10-29 15:54:48,695 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-0efdb82c915f4fb898372149bb81e5ee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594868369 2023-10-29 15:54:48,696 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-47c0a833191548458ff082153b53abee, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594869786 2023-10-29 15:54:48,700 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:48,703 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:48,703 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3572db5871b549a818fbe28bd8653d46, NAME => 'ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 15:54:48,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:48,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:48,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:48,704 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:48,706 INFO [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:48,708 DEBUG [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1 2023-10-29 15:54:48,708 DEBUG [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1 2023-10-29 15:54:48,708 INFO [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3572db5871b549a818fbe28bd8653d46 columnFamilyName family1 2023-10-29 15:54:48,710 INFO [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] regionserver.HStore(310): Store=3572db5871b549a818fbe28bd8653d46/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:48,710 INFO [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:48,712 DEBUG [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2 2023-10-29 15:54:48,712 DEBUG [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2 2023-10-29 15:54:48,712 INFO [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3572db5871b549a818fbe28bd8653d46 columnFamilyName family2 2023-10-29 15:54:48,713 INFO [StoreOpener-3572db5871b549a818fbe28bd8653d46-1] regionserver.HStore(310): Store=3572db5871b549a818fbe28bd8653d46/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:48,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:48,715 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:48,715 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] throttle.PressureAwareThroughputController(145): b797a02ca671ca72e9ef2c194aacc001#family2#compaction#117 average throughput is 0.58 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:48,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:48,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 3572db5871b549a818fbe28bd8653d46 2023-10-29 15:54:48,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:54:48,719 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 3572db5871b549a818fbe28bd8653d46; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69673851, jitterRate=0.03822128474712372}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:48,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:54:48,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46., pid=109, masterSystemTime=1698594888700 2023-10-29 15:54:48,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:48,721 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:48,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:48,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 99df69438d2ae3350f006d99e0fba202, NAME => 'ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 15:54:48,722 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=3572db5871b549a818fbe28bd8653d46, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:48,722 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698594888722"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594888722"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594888722"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594888722"}]},"ts":"1698594888722"} 2023-10-29 15:54:48,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:48,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:48,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:48,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:48,724 INFO [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:48,725 DEBUG [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1 2023-10-29 15:54:48,725 DEBUG [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1 2023-10-29 15:54:48,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=106 2023-10-29 15:54:48,725 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 3572db5871b549a818fbe28bd8653d46, server=jenkins-hbase20.apache.org,44603,1698594767651 in 176 msec 2023-10-29 15:54:48,726 INFO [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99df69438d2ae3350f006d99e0fba202 columnFamilyName family1 2023-10-29 15:54:48,727 INFO [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] regionserver.HStore(310): Store=99df69438d2ae3350f006d99e0fba202/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:48,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=3572db5871b549a818fbe28bd8653d46, ASSIGN in 340 msec 2023-10-29 15:54:48,727 INFO [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:48,728 DEBUG [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2 2023-10-29 15:54:48,728 DEBUG [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2 2023-10-29 15:54:48,728 INFO [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 99df69438d2ae3350f006d99e0fba202 columnFamilyName family2 2023-10-29 15:54:48,729 INFO [StoreOpener-99df69438d2ae3350f006d99e0fba202-1] regionserver.HStore(310): Store=99df69438d2ae3350f006d99e0fba202/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:48,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:48,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:48,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:48,731 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 99df69438d2ae3350f006d99e0fba202 2023-10-29 15:54:48,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:54:48,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 99df69438d2ae3350f006d99e0fba202; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65165501, jitterRate=-0.028958365321159363}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:48,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:48,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202., pid=110, masterSystemTime=1698594888700 2023-10-29 15:54:48,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:48,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:48,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:48,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7fae007a80bb8183f2e1263b83980058, NAME => 'ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 15:54:48,735 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=99df69438d2ae3350f006d99e0fba202, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:48,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:48,735 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1698594888735"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594888735"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594888735"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594888735"}]},"ts":"1698594888735"} 2023-10-29 15:54:48,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:54:48,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:48,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:48,736 INFO [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:48,737 DEBUG [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1 2023-10-29 15:54:48,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=110, resume processing ppid=108 2023-10-29 15:54:48,737 DEBUG [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1 2023-10-29 15:54:48,737 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=110, ppid=108, state=SUCCESS; OpenRegionProcedure 99df69438d2ae3350f006d99e0fba202, server=jenkins-hbase20.apache.org,44603,1698594767651 in 188 msec 2023-10-29 15:54:48,738 INFO [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fae007a80bb8183f2e1263b83980058 columnFamilyName family1 2023-10-29 15:54:48,738 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=99df69438d2ae3350f006d99e0fba202, ASSIGN in 351 msec 2023-10-29 15:54:48,738 INFO [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] regionserver.HStore(310): Store=7fae007a80bb8183f2e1263b83980058/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:48,739 INFO [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:48,740 DEBUG [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2 2023-10-29 15:54:48,740 DEBUG [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2 2023-10-29 15:54:48,740 INFO [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7fae007a80bb8183f2e1263b83980058 columnFamilyName family2 2023-10-29 15:54:48,741 INFO [StoreOpener-7fae007a80bb8183f2e1263b83980058-1] regionserver.HStore(310): Store=7fae007a80bb8183f2e1263b83980058/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:54:48,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:48,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:48,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:54:48,745 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 7fae007a80bb8183f2e1263b83980058 2023-10-29 15:54:48,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:54:48,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 7fae007a80bb8183f2e1263b83980058; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73826270, jitterRate=0.10009714961051941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:54:48,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:54:48,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058., pid=111, masterSystemTime=1698594888700 2023-10-29 15:54:48,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:48,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:48,749 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=7fae007a80bb8183f2e1263b83980058, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:48,749 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1698594888749"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594888749"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594888749"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594888749"}]},"ts":"1698594888749"} 2023-10-29 15:54:48,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=111, resume processing ppid=107 2023-10-29 15:54:48,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, ppid=107, state=SUCCESS; OpenRegionProcedure 7fae007a80bb8183f2e1263b83980058, server=jenkins-hbase20.apache.org,44603,1698594767651 in 201 msec 2023-10-29 15:54:48,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-10-29 15:54:48,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=7fae007a80bb8183f2e1263b83980058, ASSIGN in 366 msec 2023-10-29 15:54:48,754 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:54:48,754 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594888754"}]},"ts":"1698594888754"} 2023-10-29 15:54:48,755 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-10-29 15:54:48,756 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:54:48,757 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2190 sec 2023-10-29 15:54:48,762 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-00ebbe4c51b84172a385e2617756c581, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-2cbf42ea71ea49cb98954f10d6b34b4f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-577cfa53a74943fd8c7937320207ca86, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-55028e7d7a304addae500f20f73df562, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/dc83e96b966c48b3a03738740a385b03_SeqId_34_] to archive 2023-10-29 15:54:48,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:48,765 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-00ebbe4c51b84172a385e2617756c581 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-00ebbe4c51b84172a385e2617756c581 2023-10-29 15:54:48,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-2cbf42ea71ea49cb98954f10d6b34b4f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-2cbf42ea71ea49cb98954f10d6b34b4f 2023-10-29 15:54:48,767 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-577cfa53a74943fd8c7937320207ca86 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-577cfa53a74943fd8c7937320207ca86 2023-10-29 15:54:48,769 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-55028e7d7a304addae500f20f73df562 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-55028e7d7a304addae500f20f73df562 2023-10-29 15:54:48,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/dc83e96b966c48b3a03738740a385b03_SeqId_34_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family1/dc83e96b966c48b3a03738740a385b03_SeqId_34_ 2023-10-29 15:54:49,151 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/.tmp/family2/fb4145e622dc47c8a59fb7fa9e891b87 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/fb4145e622dc47c8a59fb7fa9e891b87 2023-10-29 15:54:49,159 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 2b71995fd137b23273faaf22b15f18e6/family2 of 2b71995fd137b23273faaf22b15f18e6 into fb4145e622dc47c8a59fb7fa9e891b87(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:54:49,159 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:54:49,159 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6., storeName=2b71995fd137b23273faaf22b15f18e6/family2, priority=12, startTime=1698594886310; duration=0sec 2023-10-29 15:54:49,159 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-10-29 15:54:49,159 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-29 15:54:49,160 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-29 15:54:49,160 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-29 15:54:49,160 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. because compaction request was cancelled 2023-10-29 15:54:49,160 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-10-29 15:54:49,161 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-10-29 15:54:49,161 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-10-29 15:54:49,161 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. because compaction request was cancelled 2023-10-29 15:54:49,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-6911e45244944f6ebfcb6053aea6dcc4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-abf154bd95e34d5fad5d940cb1145515, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-9b5dbc115cee4baaae779c69d6fc4786, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-ec6f57d32d1c4bbab74116512951ee95] to archive 2023-10-29 15:54:49,162 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:49,165 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-6911e45244944f6ebfcb6053aea6dcc4 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-6911e45244944f6ebfcb6053aea6dcc4 2023-10-29 15:54:49,166 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-abf154bd95e34d5fad5d940cb1145515 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-abf154bd95e34d5fad5d940cb1145515 2023-10-29 15:54:49,167 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-9b5dbc115cee4baaae779c69d6fc4786 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-9b5dbc115cee4baaae779c69d6fc4786 2023-10-29 15:54:49,168 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-ec6f57d32d1c4bbab74116512951ee95 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/family2/testCompactionWithHFileLink=2b71995fd137b23273faaf22b15f18e6-ec6f57d32d1c4bbab74116512951ee95 2023-10-29 15:54:49,471 DEBUG [regionserver/jenkins-hbase20:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-10-29 15:54:49,483 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-10-29 15:54:49,545 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/.tmp/family2/213e01ab042e42f19f93659fd8e51994 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/213e01ab042e42f19f93659fd8e51994 2023-10-29 15:54:49,552 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in b797a02ca671ca72e9ef2c194aacc001/family2 of b797a02ca671ca72e9ef2c194aacc001 into 213e01ab042e42f19f93659fd8e51994(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:54:49,552 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:54:49,553 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001., storeName=b797a02ca671ca72e9ef2c194aacc001/family2, priority=12, startTime=1698594886242; duration=0sec 2023-10-29 15:54:49,553 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:54:49,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a0859aaead604b2f8dee52429eea45ba, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-c616c72db0954768bb5f370af46f9c8c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-0efdb82c915f4fb898372149bb81e5ee, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-47c0a833191548458ff082153b53abee] to archive 2023-10-29 15:54:49,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:49,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a0859aaead604b2f8dee52429eea45ba to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-a0859aaead604b2f8dee52429eea45ba 2023-10-29 15:54:49,569 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-c616c72db0954768bb5f370af46f9c8c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-c616c72db0954768bb5f370af46f9c8c 2023-10-29 15:54:49,570 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-0efdb82c915f4fb898372149bb81e5ee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-0efdb82c915f4fb898372149bb81e5ee 2023-10-29 15:54:49,572 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-47c0a833191548458ff082153b53abee to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/family2/testCompactionWithHFileLink=b797a02ca671ca72e9ef2c194aacc001-47c0a833191548458ff082153b53abee 2023-10-29 15:54:49,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-10-29 15:54:49,650 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-10-29 15:54:49,663 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:49,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:49,664 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:49,668 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:49,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 15:54:49,669 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 15:54:49,669 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:49,669 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 15:54:49,669 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 15:54:49,670 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:49,670 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:49,671 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:49,671 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:49,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:49,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:49,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:49,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:49,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:49,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:49,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:49,673 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 15:54:49,673 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 15:54:49,673 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 15:54:49,673 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:49,673 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 15:54:49,673 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:49,673 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. started... 2023-10-29 15:54:49,673 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:49,674 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:49,675 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. started... 2023-10-29 15:54:49,673 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:49,675 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99df69438d2ae3350f006d99e0fba202 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:54:49,674 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:49,675 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7fae007a80bb8183f2e1263b83980058 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:54:49,675 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. started... 2023-10-29 15:54:49,676 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3572db5871b549a818fbe28bd8653d46 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:54:50,096 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029afadd907d15d4c8e8b0e70abba2e4629 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029afadd907d15d4c8e8b0e70abba2e4629 2023-10-29 15:54:50,096 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102957d228cfbfec4a6c9c4fb47fcb581a16 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023102957d228cfbfec4a6c9c4fb47fcb581a16 2023-10-29 15:54:50,100 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102910ab7ea3e0a94d8791b9c418adda369c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023102910ab7ea3e0a94d8791b9c418adda369c 2023-10-29 15:54:50,506 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/ac0d91ba2cd540f9bfa18ea091572210 2023-10-29 15:54:50,506 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/1728c515da5a4c3aa188cfbb9cb8cfbd 2023-10-29 15:54:50,508 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/f8c594e1f31c426f84b49025241563c5 2023-10-29 15:54:50,937 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102944f6121b875443d09201bcfc54213a92 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023102944f6121b875443d09201bcfc54213a92 2023-10-29 15:54:50,938 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310290ed7f9d903fa4a82b65f2db605584e4e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310290ed7f9d903fa4a82b65f2db605584e4e 2023-10-29 15:54:50,938 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102951a13de1211d41b1a8562582d52194bf to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023102951a13de1211d41b1a8562582d52194bf 2023-10-29 15:54:51,345 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/47cf967d8a1141429b46b6071eb1b68a 2023-10-29 15:54:51,345 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/77ea194f51e249488b323cabc48e4aab 2023-10-29 15:54:51,345 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/bb482d7cdc014ad093088f2af5f00df4 2023-10-29 15:54:51,354 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/ac0d91ba2cd540f9bfa18ea091572210 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ac0d91ba2cd540f9bfa18ea091572210 2023-10-29 15:54:51,354 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/1728c515da5a4c3aa188cfbb9cb8cfbd as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/1728c515da5a4c3aa188cfbb9cb8cfbd 2023-10-29 15:54:51,354 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/f8c594e1f31c426f84b49025241563c5 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/f8c594e1f31c426f84b49025241563c5 2023-10-29 15:54:51,358 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/f8c594e1f31c426f84b49025241563c5, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 15:54:51,358 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/1728c515da5a4c3aa188cfbb9cb8cfbd, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 15:54:51,358 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ac0d91ba2cd540f9bfa18ea091572210, entries=4, sequenceid=5, filesize=5.4 K 2023-10-29 15:54:51,358 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/47cf967d8a1141429b46b6071eb1b68a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/47cf967d8a1141429b46b6071eb1b68a 2023-10-29 15:54:51,358 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/bb482d7cdc014ad093088f2af5f00df4 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/bb482d7cdc014ad093088f2af5f00df4 2023-10-29 15:54:51,358 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/77ea194f51e249488b323cabc48e4aab as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/77ea194f51e249488b323cabc48e4aab 2023-10-29 15:54:51,362 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/bb482d7cdc014ad093088f2af5f00df4, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:54:51,362 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/47cf967d8a1141429b46b6071eb1b68a, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:54:51,363 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/77ea194f51e249488b323cabc48e4aab, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:54:51,363 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 7fae007a80bb8183f2e1263b83980058 in 1688ms, sequenceid=5, compaction requested=false 2023-10-29 15:54:51,363 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3572db5871b549a818fbe28bd8653d46 in 1687ms, sequenceid=5, compaction requested=false 2023-10-29 15:54:51,364 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:54:51,364 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:54:51,364 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:51,364 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:51,364 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:51,364 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:51,364 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 99df69438d2ae3350f006d99e0fba202 in 1689ms, sequenceid=5, compaction requested=false 2023-10-29 15:54:51,364 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:51,364 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:51,364 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:51,364 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:51,364 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,364 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 15:54:51,364 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 15:54:51,365 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,365 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:51,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:51,365 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:51,366 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:51,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 15:54:51,367 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b724aac[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:51,367 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 15:54:51,367 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:51,367 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:51,367 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:51,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:51,368 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 15:54:51,368 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 15:54:51,368 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,368 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:51,368 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:51,368 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 15:54:51,368 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,368 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:51,368 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 15:54:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:51,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:51,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:51,370 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 15:54:51,370 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 15:54:51,370 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:51,370 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:51,370 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 15:54:51,370 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:51,371 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,371 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:51,371 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,371 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:51,371 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,372 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:51,372 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,372 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:51,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:51,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:51,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 15:54:51,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:51,374 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:51,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:51,374 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:51,375 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:51,375 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:51,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:51,475 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:51,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:51,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:51,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:51,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:51,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:51,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:51,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 15:54:51,484 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 15:54:51,484 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:51,484 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 15:54:51,484 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 15:54:51,485 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,485 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:51,486 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,486 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:51,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:51,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:51,487 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:51,487 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:51,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:51,488 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:51,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:51,488 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 15:54:51,489 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 15:54:51,489 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 15:54:51,489 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 15:54:51,489 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:51,489 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 15:54:51,489 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:51,489 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:51,489 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:51,490 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:51,490 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. started... 2023-10-29 15:54:51,489 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. started... 2023-10-29 15:54:51,490 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:51,490 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. started... 2023-10-29 15:54:51,490 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99df69438d2ae3350f006d99e0fba202 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:54:51,490 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7fae007a80bb8183f2e1263b83980058 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:54:51,490 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3572db5871b549a818fbe28bd8653d46 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:54:51,905 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310295c23d36aa76043019350ae3a8755814b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202310295c23d36aa76043019350ae3a8755814b 2023-10-29 15:54:51,905 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029d8d73b73e77b425e8e32e578685a4f36 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231029d8d73b73e77b425e8e32e578685a4f36 2023-10-29 15:54:51,905 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102992ca179977e5497bbbdb292c843d16f1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023102992ca179977e5497bbbdb292c843d16f1 2023-10-29 15:54:52,310 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/b1e8dc1647324a17a3277fa8d56db375 2023-10-29 15:54:52,310 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/456540a09549408bbd6ce43e1034a13f 2023-10-29 15:54:52,310 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/981359d410024552b6b32ba230691583 2023-10-29 15:54:52,741 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029537d50e9679c4ccdb58cab93e18b68cb to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231029537d50e9679c4ccdb58cab93e18b68cb 2023-10-29 15:54:52,742 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029792f3fe6a8fc4683a02f2823337f9ead to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231029792f3fe6a8fc4683a02f2823337f9ead 2023-10-29 15:54:52,742 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029090bb424ca55481fbe24538c8bdd57ab to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231029090bb424ca55481fbe24538c8bdd57ab 2023-10-29 15:54:53,146 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/06dbaee54834495ab26ca4859c3dfe20 2023-10-29 15:54:53,146 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/0d2428aa162b4993a028bd002426fefe 2023-10-29 15:54:53,148 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/767613f1b38e41dfaa38719ed2d6311d 2023-10-29 15:54:53,152 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/b1e8dc1647324a17a3277fa8d56db375 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/b1e8dc1647324a17a3277fa8d56db375 2023-10-29 15:54:53,152 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/981359d410024552b6b32ba230691583 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/981359d410024552b6b32ba230691583 2023-10-29 15:54:53,153 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/456540a09549408bbd6ce43e1034a13f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/456540a09549408bbd6ce43e1034a13f 2023-10-29 15:54:53,157 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/b1e8dc1647324a17a3277fa8d56db375, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 15:54:53,157 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/981359d410024552b6b32ba230691583, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 15:54:53,157 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/456540a09549408bbd6ce43e1034a13f, entries=4, sequenceid=9, filesize=5.4 K 2023-10-29 15:54:53,158 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/0d2428aa162b4993a028bd002426fefe as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/0d2428aa162b4993a028bd002426fefe 2023-10-29 15:54:53,158 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/06dbaee54834495ab26ca4859c3dfe20 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/06dbaee54834495ab26ca4859c3dfe20 2023-10-29 15:54:53,158 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/767613f1b38e41dfaa38719ed2d6311d as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/767613f1b38e41dfaa38719ed2d6311d 2023-10-29 15:54:53,161 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/0d2428aa162b4993a028bd002426fefe, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:54:53,162 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/767613f1b38e41dfaa38719ed2d6311d, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:54:53,162 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/06dbaee54834495ab26ca4859c3dfe20, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:54:53,162 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 99df69438d2ae3350f006d99e0fba202 in 1672ms, sequenceid=9, compaction requested=false 2023-10-29 15:54:53,162 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 7fae007a80bb8183f2e1263b83980058 in 1672ms, sequenceid=9, compaction requested=false 2023-10-29 15:54:53,162 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:53,162 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3572db5871b549a818fbe28bd8653d46 in 1672ms, sequenceid=9, compaction requested=false 2023-10-29 15:54:53,162 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:53,162 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:54:53,163 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:53,163 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:54:53,163 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:53,163 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:53,163 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:53,163 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:53,163 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:53,163 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,163 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 15:54:53,163 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 15:54:53,165 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,165 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:53,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:53,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:53,165 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:53,165 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:53,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:53,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:53,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:53,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:53,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 15:54:53,166 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@751eda7d[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:53,166 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 15:54:53,166 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:53,167 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:53,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:53,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:53,167 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 15:54:53,167 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 15:54:53,167 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:53,167 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,167 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:53,168 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,168 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 15:54:53,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:53,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:53,168 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:53,168 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 15:54:53,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:53,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:53,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:53,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:53,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:53,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:53,170 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 15:54:53,170 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 15:54:53,170 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:53,170 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:53,170 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 15:54:53,170 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:53,171 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,171 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:53,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,171 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:53,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:53,171 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,172 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:53,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,173 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,173 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:53,173 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:53,174 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:53,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:53,174 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:53,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 15:54:53,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:53,174 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:53,174 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,174 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:53,174 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:53,174 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,174 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:53,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:53,174 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:53,174 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:53,274 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:53,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:53,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:53,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:53,277 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:53,279 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:53,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:53,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 15:54:53,281 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 15:54:53,281 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:53,281 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 15:54:53,281 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 15:54:53,282 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,282 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:53,282 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:53,282 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:53,283 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:53,283 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:53,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:53,283 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:53,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:53,284 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 15:54:53,284 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 15:54:53,284 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 15:54:53,284 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 15:54:53,284 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:53,284 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 15:54:53,286 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:53,286 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. started... 2023-10-29 15:54:53,286 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:53,286 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. started... 2023-10-29 15:54:53,286 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99df69438d2ae3350f006d99e0fba202 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:54:53,286 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3572db5871b549a818fbe28bd8653d46 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:54:53,286 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:53,286 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:53,286 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:53,286 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. started... 2023-10-29 15:54:53,286 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7fae007a80bb8183f2e1263b83980058 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:54:53,301 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310291375adf30bee451aaba76c423867eae3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202310291375adf30bee451aaba76c423867eae3 2023-10-29 15:54:53,707 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/92206886da884bf0b1b8ff1e8e6e9d2a 2023-10-29 15:54:53,715 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029006df842465d44b8b14312cc4cc8eec1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029006df842465d44b8b14312cc4cc8eec1 2023-10-29 15:54:53,715 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029394bec297f294b758c25e0c4339af78a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231029394bec297f294b758c25e0c4339af78a 2023-10-29 15:54:53,806 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/df3317800c0a466eb17c1304c2f264ba 2023-10-29 15:54:53,898 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102978f634c4d9cb4fedaf39e3567c25b196 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023102978f634c4d9cb4fedaf39e3567c25b196 2023-10-29 15:54:54,205 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029033abec395c84c1fb19805a6d1ba1685 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231029033abec395c84c1fb19805a6d1ba1685 2023-10-29 15:54:54,206 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:54:54,223 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/4fd639e2e07d4c028c988aca94333c5a 2023-10-29 15:54:54,271 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310299b9ecff03e4849df9dd8ffe815b3fccd to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310299b9ecff03e4849df9dd8ffe815b3fccd 2023-10-29 15:54:54,283 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/953d811dd1e4448aa6b105aed3d009c3 2023-10-29 15:54:54,295 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/4fd639e2e07d4c028c988aca94333c5a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4fd639e2e07d4c028c988aca94333c5a 2023-10-29 15:54:54,303 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4fd639e2e07d4c028c988aca94333c5a, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 15:54:54,304 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/953d811dd1e4448aa6b105aed3d009c3 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/953d811dd1e4448aa6b105aed3d009c3 2023-10-29 15:54:54,310 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/953d811dd1e4448aa6b105aed3d009c3, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:54:54,311 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3572db5871b549a818fbe28bd8653d46 in 1025ms, sequenceid=13, compaction requested=true 2023-10-29 15:54:54,311 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:54:54,311 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:54,311 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:54,324 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/5596f5c7cced42049e740cdd2f94629a 2023-10-29 15:54:54,329 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/df3317800c0a466eb17c1304c2f264ba as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/df3317800c0a466eb17c1304c2f264ba 2023-10-29 15:54:54,334 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/df3317800c0a466eb17c1304c2f264ba, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 15:54:54,335 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/5596f5c7cced42049e740cdd2f94629a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/5596f5c7cced42049e740cdd2f94629a 2023-10-29 15:54:54,347 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/5596f5c7cced42049e740cdd2f94629a, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:54:54,349 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 7fae007a80bb8183f2e1263b83980058 in 1063ms, sequenceid=13, compaction requested=true 2023-10-29 15:54:54,349 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:54:54,349 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:54,349 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:54,640 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/cff809b92f0c4cf39ca97b7ebad4038d 2023-10-29 15:54:54,644 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/92206886da884bf0b1b8ff1e8e6e9d2a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/92206886da884bf0b1b8ff1e8e6e9d2a 2023-10-29 15:54:54,651 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/92206886da884bf0b1b8ff1e8e6e9d2a, entries=4, sequenceid=13, filesize=5.4 K 2023-10-29 15:54:54,653 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/cff809b92f0c4cf39ca97b7ebad4038d as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/cff809b92f0c4cf39ca97b7ebad4038d 2023-10-29 15:54:54,658 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/cff809b92f0c4cf39ca97b7ebad4038d, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:54:54,659 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 99df69438d2ae3350f006d99e0fba202 in 1373ms, sequenceid=13, compaction requested=true 2023-10-29 15:54:54,659 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:54,659 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:54,659 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:54,659 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:54,659 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,660 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 15:54:54,660 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 15:54:54,661 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:54,662 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:54,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:54,663 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:54,663 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:54,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:54,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 15:54:54,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@15c99cf7[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:54,664 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 15:54:54,664 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:54,665 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:54,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:54,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:54,665 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 15:54:54,665 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 15:54:54,665 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:54,665 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,665 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:54,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 15:54:54,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:54,666 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 15:54:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:54,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:54,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:54,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:54,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:54,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:54,673 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 15:54:54,673 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 15:54:54,673 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:54,673 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:54,673 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 15:54:54,673 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:54,675 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,675 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:54,675 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:54,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:54,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:54,677 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:54,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:54,678 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:54,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,680 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:54,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:54,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:54,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:54,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:54,680 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:54,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:54,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:54,780 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:54,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:54,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:54,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:54,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:54:54,785 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:54,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:54,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 15:54:54,788 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 15:54:54,788 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:54,788 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 15:54:54,788 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 15:54:54,788 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,788 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:54,789 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:54,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:54,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:54,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:54,790 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:54,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:54,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:54,790 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 15:54:54,790 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,790 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 15:54:54,791 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 15:54:54,791 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:54,791 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 15:54:54,791 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:54,791 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:54,791 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 15:54:54,791 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:54,791 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. started... 2023-10-29 15:54:54,791 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99df69438d2ae3350f006d99e0fba202 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:54:54,792 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:54,792 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. started... 2023-10-29 15:54:54,792 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:54,792 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:54,792 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:54,792 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3572db5871b549a818fbe28bd8653d46 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:54:54,792 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. started... 2023-10-29 15:54:54,792 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7fae007a80bb8183f2e1263b83980058 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:54:55,214 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029b54768c281bc4d8a9f0c65e84970a63b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029b54768c281bc4d8a9f0c65e84970a63b 2023-10-29 15:54:55,222 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310292074b82432004507b6e23fbc9de19f0c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b202310292074b82432004507b6e23fbc9de19f0c 2023-10-29 15:54:55,223 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029a10deeeb1d53497cb55f204b558396de to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029a10deeeb1d53497cb55f204b558396de 2023-10-29 15:54:55,622 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/9446ef0e72b140238a3b0725fd688c35 2023-10-29 15:54:55,627 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/056f504393c94548ac4c6ffb04ecd4e9 2023-10-29 15:54:55,627 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/71aec1296c28430bbe307a3f0817ab57 2023-10-29 15:54:55,660 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310293f739fa018414b15ad3b024ec666f485 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202310293f739fa018414b15ad3b024ec666f485 2023-10-29 15:54:56,050 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310298562a4aefc18448f93ba12d89f9c3952 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202310298562a4aefc18448f93ba12d89f9c3952 2023-10-29 15:54:56,059 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/8ee2d36beff34bb68039ba6307f44ff9 2023-10-29 15:54:56,062 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310298699c8b52c1045bc8ff5d29211a5d767 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e202310298699c8b52c1045bc8ff5d29211a5d767 2023-10-29 15:54:56,067 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/71aec1296c28430bbe307a3f0817ab57 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/71aec1296c28430bbe307a3f0817ab57 2023-10-29 15:54:56,069 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/1f92526315f247bcb3b436230c5a393c 2023-10-29 15:54:56,070 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/71aec1296c28430bbe307a3f0817ab57, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 15:54:56,071 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/8ee2d36beff34bb68039ba6307f44ff9 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/8ee2d36beff34bb68039ba6307f44ff9 2023-10-29 15:54:56,072 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/9446ef0e72b140238a3b0725fd688c35 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/9446ef0e72b140238a3b0725fd688c35 2023-10-29 15:54:56,075 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/8ee2d36beff34bb68039ba6307f44ff9, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:54:56,076 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 7fae007a80bb8183f2e1263b83980058 in 1284ms, sequenceid=17, compaction requested=true 2023-10-29 15:54:56,076 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:54:56,076 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:56,076 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:56,082 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/9446ef0e72b140238a3b0725fd688c35, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 15:54:56,082 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/1f92526315f247bcb3b436230c5a393c as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/1f92526315f247bcb3b436230c5a393c 2023-10-29 15:54:56,088 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/1f92526315f247bcb3b436230c5a393c, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:54:56,088 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 99df69438d2ae3350f006d99e0fba202 in 1297ms, sequenceid=17, compaction requested=true 2023-10-29 15:54:56,088 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:56,088 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:56,088 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:56,472 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/589033e2f374496092dfc4dc943697cc 2023-10-29 15:54:56,478 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/056f504393c94548ac4c6ffb04ecd4e9 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/056f504393c94548ac4c6ffb04ecd4e9 2023-10-29 15:54:56,481 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/056f504393c94548ac4c6ffb04ecd4e9, entries=4, sequenceid=17, filesize=5.4 K 2023-10-29 15:54:56,482 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/589033e2f374496092dfc4dc943697cc as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/589033e2f374496092dfc4dc943697cc 2023-10-29 15:54:56,486 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/589033e2f374496092dfc4dc943697cc, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:54:56,487 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3572db5871b549a818fbe28bd8653d46 in 1695ms, sequenceid=17, compaction requested=true 2023-10-29 15:54:56,487 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:54:56,487 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:56,487 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:56,487 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:56,487 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,487 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 15:54:56,487 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 15:54:56,488 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,488 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:56,488 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:56,488 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:56,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:56,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 15:54:56,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f1bb4c[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:56,492 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 15:54:56,492 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:56,494 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:56,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:56,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:56,494 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 15:54:56,494 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 15:54:56,494 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:56,495 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,495 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:56,496 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 15:54:56,496 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:56,496 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 15:54:56,496 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:56,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:56,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:56,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:56,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:56,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 15:54:56,498 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 15:54:56,498 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:56,498 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:56,498 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 15:54:56,498 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:56,499 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,499 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:56,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:56,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:56,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,500 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,500 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,501 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:56,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:56,502 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,502 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:56,502 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:56,502 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:56,503 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:56,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:56,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:56,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 15:54:56,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:56,503 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:56,503 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,503 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:56,503 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:56,503 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,503 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:56,503 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:56,504 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:56,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:56,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:56,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-29 15:54:56,603 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:56,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:56,623 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:56,635 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:56,643 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:54:56,646 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:54:56,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:54:56,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-10-29 15:54:56,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-10-29 15:54:56,702 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-10-29 15:54:56,702 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:56,702 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-10-29 15:54:56,702 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-10-29 15:54:56,704 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,704 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:56,705 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:56,705 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:56,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:56,705 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:56,705 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:56,705 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:54:56,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:56,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:54:56,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:56,706 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-10-29 15:54:56,706 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-10-29 15:54:56,706 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-10-29 15:54:56,706 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-10-29 15:54:56,706 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:54:56,706 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-10-29 15:54:56,706 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:56,706 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. started... 2023-10-29 15:54:56,707 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 99df69438d2ae3350f006d99e0fba202 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:54:56,707 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:56,707 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. started... 2023-10-29 15:54:56,707 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 3572db5871b549a818fbe28bd8653d46 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:54:56,707 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:54:56,707 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:54:56,708 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:56,708 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. started... 2023-10-29 15:54:56,708 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 7fae007a80bb8183f2e1263b83980058 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:54:56,744 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/e061526b9b284ca9884d4e404b28e417 2023-10-29 15:54:56,747 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e061526b9b284ca9884d4e404b28e417 2023-10-29 15:54:57,122 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/e113b3006f5c437d98ee76c53a409060 2023-10-29 15:54:57,128 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e113b3006f5c437d98ee76c53a409060 2023-10-29 15:54:57,136 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/816d3bd7ea974b8786b4610ecb3a98de 2023-10-29 15:54:57,144 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 816d3bd7ea974b8786b4610ecb3a98de 2023-10-29 15:54:57,175 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/360411fcaafe4105bfaa2f7c65ee01de 2023-10-29 15:54:57,178 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 360411fcaafe4105bfaa2f7c65ee01de 2023-10-29 15:54:57,179 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/e061526b9b284ca9884d4e404b28e417 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/e061526b9b284ca9884d4e404b28e417 2023-10-29 15:54:57,183 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e061526b9b284ca9884d4e404b28e417 2023-10-29 15:54:57,183 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/e061526b9b284ca9884d4e404b28e417, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 15:54:57,184 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/360411fcaafe4105bfaa2f7c65ee01de as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/360411fcaafe4105bfaa2f7c65ee01de 2023-10-29 15:54:57,192 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 360411fcaafe4105bfaa2f7c65ee01de 2023-10-29 15:54:57,192 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/360411fcaafe4105bfaa2f7c65ee01de, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 15:54:57,195 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 7fae007a80bb8183f2e1263b83980058 in 487ms, sequenceid=23, compaction requested=true 2023-10-29 15:54:57,195 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:54:57,195 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:54:57,195 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:54:57,551 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/932b326dcf554e9ebe08cd575ccce918 2023-10-29 15:54:57,561 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 932b326dcf554e9ebe08cd575ccce918 2023-10-29 15:54:57,562 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/e113b3006f5c437d98ee76c53a409060 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/e113b3006f5c437d98ee76c53a409060 2023-10-29 15:54:57,572 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e113b3006f5c437d98ee76c53a409060 2023-10-29 15:54:57,572 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/e113b3006f5c437d98ee76c53a409060, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 15:54:57,573 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/932b326dcf554e9ebe08cd575ccce918 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/932b326dcf554e9ebe08cd575ccce918 2023-10-29 15:54:57,579 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 932b326dcf554e9ebe08cd575ccce918 2023-10-29 15:54:57,579 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/932b326dcf554e9ebe08cd575ccce918, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 15:54:57,580 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 99df69438d2ae3350f006d99e0fba202 in 873ms, sequenceid=23, compaction requested=true 2023-10-29 15:54:57,580 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:57,580 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:57,580 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:54:57,970 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/efc9567d4ff1426ab5c3d4fefbb9d74a 2023-10-29 15:54:57,975 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for efc9567d4ff1426ab5c3d4fefbb9d74a 2023-10-29 15:54:57,976 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/816d3bd7ea974b8786b4610ecb3a98de as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/816d3bd7ea974b8786b4610ecb3a98de 2023-10-29 15:54:57,980 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 816d3bd7ea974b8786b4610ecb3a98de 2023-10-29 15:54:57,980 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/816d3bd7ea974b8786b4610ecb3a98de, entries=3, sequenceid=23, filesize=5.0 K 2023-10-29 15:54:57,981 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/efc9567d4ff1426ab5c3d4fefbb9d74a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/efc9567d4ff1426ab5c3d4fefbb9d74a 2023-10-29 15:54:57,986 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for efc9567d4ff1426ab5c3d4fefbb9d74a 2023-10-29 15:54:57,986 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/efc9567d4ff1426ab5c3d4fefbb9d74a, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 15:54:57,986 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3572db5871b549a818fbe28bd8653d46 in 1279ms, sequenceid=23, compaction requested=true 2023-10-29 15:54:57,987 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:54:57,987 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:57,987 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:54:57,987 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:54:57,987 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,987 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-10-29 15:54:57,987 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-10-29 15:54:57,988 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,988 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:57,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:57,989 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:57,989 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:54:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:57,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-10-29 15:54:57,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@588fb6f4[Count = 0] remaining members to acquire global barrier 2023-10-29 15:54:57,990 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-10-29 15:54:57,990 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:57,992 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:57,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:57,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-10-29 15:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-10-29 15:54:57,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,992 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:54:57,992 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:54:57,994 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-10-29 15:54:57,994 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,994 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:57,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:57,995 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-10-29 15:54:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:57,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:57,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:57,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:54:57,997 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-10-29 15:54:57,997 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-10-29 15:54:57,997 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:54:57,997 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:54:57,997 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-10-29 15:54:57,997 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:54:57,999 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:57,999 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:57,999 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:54:57,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:54:57,999 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:57,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:54:57,999 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:58,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:58,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:58,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:54:58,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:58,000 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:58,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:58,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:54:58,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-10-29 15:54:58,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:58,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:54:58,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:58,002 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:54:58,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-10-29 15:54:58,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-10-29 15:54:58,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:54:58,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:54:58,002 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:54:58,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-10-29 15:54:58,003 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-10-29 15:54:58,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:54:58,002 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:54:58,003 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:54:58,003 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:58,003 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-10-29 15:54:58,003 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-10-29 15:54:58,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:54:58,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:54:58,103 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:54:58,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:54:58,104 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:58,104 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 99df69438d2ae3350f006d99e0fba202/family1 is initiating major compaction (all files) 2023-10-29 15:54:58,104 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:58,104 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:58,105 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 99df69438d2ae3350f006d99e0fba202/family1 in ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:58,105 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ac0d91ba2cd540f9bfa18ea091572210, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/456540a09549408bbd6ce43e1034a13f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/92206886da884bf0b1b8ff1e8e6e9d2a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/9446ef0e72b140238a3b0725fd688c35, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/e113b3006f5c437d98ee76c53a409060] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp, totalSize=26.6 K 2023-10-29 15:54:58,106 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting ac0d91ba2cd540f9bfa18ea091572210, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594889664 2023-10-29 15:54:58,106 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 456540a09549408bbd6ce43e1034a13f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594891477 2023-10-29 15:54:58,107 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 92206886da884bf0b1b8ff1e8e6e9d2a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594893277 2023-10-29 15:54:58,108 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 9446ef0e72b140238a3b0725fd688c35, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594894783 2023-10-29 15:54:58,108 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting e113b3006f5c437d98ee76c53a409060, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:54:58,129 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 99df69438d2ae3350f006d99e0fba202#family1#compaction#148 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:58,546 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023102964c7fec6f5ca40fc9e78e1ad22d6d536_del 2023-10-29 15:54:58,546 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102964c7fec6f5ca40fc9e78e1ad22d6d536_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023102964c7fec6f5ca40fc9e78e1ad22d6d536_del 2023-10-29 15:54:59,368 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5e08d3b6a314c57902ad93ea972556b 2023-10-29 15:54:59,369 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family1/c5e08d3b6a314c57902ad93ea972556b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/c5e08d3b6a314c57902ad93ea972556b 2023-10-29 15:54:59,374 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5e08d3b6a314c57902ad93ea972556b 2023-10-29 15:54:59,375 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 99df69438d2ae3350f006d99e0fba202/family1 of 99df69438d2ae3350f006d99e0fba202 into c5e08d3b6a314c57902ad93ea972556b(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:54:59,375 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:59,375 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:59,376 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 99df69438d2ae3350f006d99e0fba202/family2 is initiating major compaction (all files) 2023-10-29 15:54:59,376 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:59,376 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:59,376 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 99df69438d2ae3350f006d99e0fba202/family2 in ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:54:59,376 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/77ea194f51e249488b323cabc48e4aab, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/767613f1b38e41dfaa38719ed2d6311d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/cff809b92f0c4cf39ca97b7ebad4038d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/1f92526315f247bcb3b436230c5a393c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/932b326dcf554e9ebe08cd575ccce918] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp, totalSize=25.3 K 2023-10-29 15:54:59,376 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 77ea194f51e249488b323cabc48e4aab, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594889664 2023-10-29 15:54:59,377 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 767613f1b38e41dfaa38719ed2d6311d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594891477 2023-10-29 15:54:59,377 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting cff809b92f0c4cf39ca97b7ebad4038d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594893277 2023-10-29 15:54:59,377 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 1f92526315f247bcb3b436230c5a393c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594894783 2023-10-29 15:54:59,377 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 932b326dcf554e9ebe08cd575ccce918, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:54:59,393 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 99df69438d2ae3350f006d99e0fba202#family2#compaction#149 average throughput is 0.20 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:59,405 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029bb0627f401604cb2825674eaf5163a8c_del 2023-10-29 15:54:59,405 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029bb0627f401604cb2825674eaf5163a8c_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231029bb0627f401604cb2825674eaf5163a8c_del 2023-10-29 15:54:59,465 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ac0d91ba2cd540f9bfa18ea091572210, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/456540a09549408bbd6ce43e1034a13f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/92206886da884bf0b1b8ff1e8e6e9d2a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/9446ef0e72b140238a3b0725fd688c35, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/e113b3006f5c437d98ee76c53a409060] to archive 2023-10-29 15:54:59,466 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:59,469 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ac0d91ba2cd540f9bfa18ea091572210 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ac0d91ba2cd540f9bfa18ea091572210 2023-10-29 15:54:59,470 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/456540a09549408bbd6ce43e1034a13f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/456540a09549408bbd6ce43e1034a13f 2023-10-29 15:54:59,471 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/92206886da884bf0b1b8ff1e8e6e9d2a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/92206886da884bf0b1b8ff1e8e6e9d2a 2023-10-29 15:54:59,472 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/9446ef0e72b140238a3b0725fd688c35 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/9446ef0e72b140238a3b0725fd688c35 2023-10-29 15:54:59,473 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/e113b3006f5c437d98ee76c53a409060 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/e113b3006f5c437d98ee76c53a409060 2023-10-29 15:54:59,816 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c37ebe8d141f4d7a9a400592fe0a2b23 2023-10-29 15:54:59,817 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/.tmp/family2/c37ebe8d141f4d7a9a400592fe0a2b23 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/c37ebe8d141f4d7a9a400592fe0a2b23 2023-10-29 15:54:59,822 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c37ebe8d141f4d7a9a400592fe0a2b23 2023-10-29 15:54:59,823 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 99df69438d2ae3350f006d99e0fba202/family2 of 99df69438d2ae3350f006d99e0fba202 into c37ebe8d141f4d7a9a400592fe0a2b23(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:54:59,823 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:54:59,823 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:54:59,823 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 3572db5871b549a818fbe28bd8653d46/family1 is initiating major compaction (all files) 2023-10-29 15:54:59,823 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:54:59,823 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:54:59,823 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 3572db5871b549a818fbe28bd8653d46/family1 in ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:54:59,824 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/1728c515da5a4c3aa188cfbb9cb8cfbd, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/b1e8dc1647324a17a3277fa8d56db375, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4fd639e2e07d4c028c988aca94333c5a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/056f504393c94548ac4c6ffb04ecd4e9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/816d3bd7ea974b8786b4610ecb3a98de] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp, totalSize=26.6 K 2023-10-29 15:54:59,824 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 1728c515da5a4c3aa188cfbb9cb8cfbd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594889663 2023-10-29 15:54:59,824 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting b1e8dc1647324a17a3277fa8d56db375, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594891477 2023-10-29 15:54:59,825 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 4fd639e2e07d4c028c988aca94333c5a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594893276 2023-10-29 15:54:59,825 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 056f504393c94548ac4c6ffb04ecd4e9, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594894782 2023-10-29 15:54:59,825 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 816d3bd7ea974b8786b4610ecb3a98de, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:54:59,835 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 3572db5871b549a818fbe28bd8653d46#family1#compaction#150 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:54:59,851 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029e4b9c69b78ff4c5a8d90982bc2866368_del 2023-10-29 15:54:59,851 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029e4b9c69b78ff4c5a8d90982bc2866368_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029e4b9c69b78ff4c5a8d90982bc2866368_del 2023-10-29 15:54:59,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/77ea194f51e249488b323cabc48e4aab, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/767613f1b38e41dfaa38719ed2d6311d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/cff809b92f0c4cf39ca97b7ebad4038d, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/1f92526315f247bcb3b436230c5a393c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/932b326dcf554e9ebe08cd575ccce918] to archive 2023-10-29 15:54:59,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:54:59,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/77ea194f51e249488b323cabc48e4aab to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/77ea194f51e249488b323cabc48e4aab 2023-10-29 15:54:59,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/767613f1b38e41dfaa38719ed2d6311d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/767613f1b38e41dfaa38719ed2d6311d 2023-10-29 15:54:59,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/cff809b92f0c4cf39ca97b7ebad4038d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/cff809b92f0c4cf39ca97b7ebad4038d 2023-10-29 15:54:59,869 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/1f92526315f247bcb3b436230c5a393c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/1f92526315f247bcb3b436230c5a393c 2023-10-29 15:54:59,870 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/932b326dcf554e9ebe08cd575ccce918 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family2/932b326dcf554e9ebe08cd575ccce918 2023-10-29 15:55:00,271 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3a19f6401cb410993e49850d42eb59f 2023-10-29 15:55:00,272 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family1/f3a19f6401cb410993e49850d42eb59f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/f3a19f6401cb410993e49850d42eb59f 2023-10-29 15:55:00,275 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f3a19f6401cb410993e49850d42eb59f 2023-10-29 15:55:00,276 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3572db5871b549a818fbe28bd8653d46/family1 of 3572db5871b549a818fbe28bd8653d46 into f3a19f6401cb410993e49850d42eb59f(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:55:00,276 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:55:00,276 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:00,277 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 3572db5871b549a818fbe28bd8653d46/family2 is initiating major compaction (all files) 2023-10-29 15:55:00,277 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:00,277 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:00,277 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 3572db5871b549a818fbe28bd8653d46/family2 in ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:55:00,278 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/bb482d7cdc014ad093088f2af5f00df4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/0d2428aa162b4993a028bd002426fefe, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/953d811dd1e4448aa6b105aed3d009c3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/589033e2f374496092dfc4dc943697cc, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/efc9567d4ff1426ab5c3d4fefbb9d74a] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp, totalSize=25.3 K 2023-10-29 15:55:00,278 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting bb482d7cdc014ad093088f2af5f00df4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594889663 2023-10-29 15:55:00,278 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 0d2428aa162b4993a028bd002426fefe, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594891477 2023-10-29 15:55:00,279 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 953d811dd1e4448aa6b105aed3d009c3, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594893276 2023-10-29 15:55:00,279 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 589033e2f374496092dfc4dc943697cc, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594894782 2023-10-29 15:55:00,281 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting efc9567d4ff1426ab5c3d4fefbb9d74a, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:00,294 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 3572db5871b549a818fbe28bd8653d46#family2#compaction#151 average throughput is 0.15 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:00,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/1728c515da5a4c3aa188cfbb9cb8cfbd, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/b1e8dc1647324a17a3277fa8d56db375, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4fd639e2e07d4c028c988aca94333c5a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/056f504393c94548ac4c6ffb04ecd4e9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/816d3bd7ea974b8786b4610ecb3a98de] to archive 2023-10-29 15:55:00,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:00,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/1728c515da5a4c3aa188cfbb9cb8cfbd to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/1728c515da5a4c3aa188cfbb9cb8cfbd 2023-10-29 15:55:00,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/b1e8dc1647324a17a3277fa8d56db375 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/b1e8dc1647324a17a3277fa8d56db375 2023-10-29 15:55:00,375 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4fd639e2e07d4c028c988aca94333c5a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4fd639e2e07d4c028c988aca94333c5a 2023-10-29 15:55:00,376 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/056f504393c94548ac4c6ffb04ecd4e9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/056f504393c94548ac4c6ffb04ecd4e9 2023-10-29 15:55:00,377 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/816d3bd7ea974b8786b4610ecb3a98de to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/816d3bd7ea974b8786b4610ecb3a98de 2023-10-29 15:55:00,706 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029eff026e75f794f8297bd7f17c1127c9e_del 2023-10-29 15:55:00,707 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029eff026e75f794f8297bd7f17c1127c9e_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231029eff026e75f794f8297bd7f17c1127c9e_del 2023-10-29 15:55:00,721 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c41d466a71aa416aa7e7a724363ad0a7 2023-10-29 15:55:00,722 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/.tmp/family2/c41d466a71aa416aa7e7a724363ad0a7 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/c41d466a71aa416aa7e7a724363ad0a7 2023-10-29 15:55:00,726 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c41d466a71aa416aa7e7a724363ad0a7 2023-10-29 15:55:00,727 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3572db5871b549a818fbe28bd8653d46/family2 of 3572db5871b549a818fbe28bd8653d46 into c41d466a71aa416aa7e7a724363ad0a7(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:55:00,727 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:55:00,727 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:00,727 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 7fae007a80bb8183f2e1263b83980058/family1 is initiating major compaction (all files) 2023-10-29 15:55:00,728 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:00,728 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:00,728 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 7fae007a80bb8183f2e1263b83980058/family1 in ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:55:00,729 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/f8c594e1f31c426f84b49025241563c5, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/981359d410024552b6b32ba230691583, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/df3317800c0a466eb17c1304c2f264ba, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/71aec1296c28430bbe307a3f0817ab57, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/e061526b9b284ca9884d4e404b28e417] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp, totalSize=26.6 K 2023-10-29 15:55:00,729 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting f8c594e1f31c426f84b49025241563c5, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594889664 2023-10-29 15:55:00,729 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 981359d410024552b6b32ba230691583, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594891477 2023-10-29 15:55:00,729 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting df3317800c0a466eb17c1304c2f264ba, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594893276 2023-10-29 15:55:00,730 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 71aec1296c28430bbe307a3f0817ab57, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594894782 2023-10-29 15:55:00,730 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting e061526b9b284ca9884d4e404b28e417, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:00,749 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 7fae007a80bb8183f2e1263b83980058#family1#compaction#152 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:00,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/bb482d7cdc014ad093088f2af5f00df4, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/0d2428aa162b4993a028bd002426fefe, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/953d811dd1e4448aa6b105aed3d009c3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/589033e2f374496092dfc4dc943697cc, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/efc9567d4ff1426ab5c3d4fefbb9d74a] to archive 2023-10-29 15:55:00,763 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:00,766 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/bb482d7cdc014ad093088f2af5f00df4 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/bb482d7cdc014ad093088f2af5f00df4 2023-10-29 15:55:00,770 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/0d2428aa162b4993a028bd002426fefe to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/0d2428aa162b4993a028bd002426fefe 2023-10-29 15:55:00,778 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/953d811dd1e4448aa6b105aed3d009c3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/953d811dd1e4448aa6b105aed3d009c3 2023-10-29 15:55:00,783 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/589033e2f374496092dfc4dc943697cc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/589033e2f374496092dfc4dc943697cc 2023-10-29 15:55:00,784 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029df77b8ff9c45491cac29a3f8aa864f17_del 2023-10-29 15:55:00,785 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029df77b8ff9c45491cac29a3f8aa864f17_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231029df77b8ff9c45491cac29a3f8aa864f17_del 2023-10-29 15:55:00,785 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/efc9567d4ff1426ab5c3d4fefbb9d74a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family2/efc9567d4ff1426ab5c3d4fefbb9d74a 2023-10-29 15:55:01,209 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fd811b8983f4fd7829dcb3294eb2866 2023-10-29 15:55:01,209 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family1/8fd811b8983f4fd7829dcb3294eb2866 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/8fd811b8983f4fd7829dcb3294eb2866 2023-10-29 15:55:01,216 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8fd811b8983f4fd7829dcb3294eb2866 2023-10-29 15:55:01,217 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7fae007a80bb8183f2e1263b83980058/family1 of 7fae007a80bb8183f2e1263b83980058 into 8fd811b8983f4fd7829dcb3294eb2866(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:55:01,217 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:55:01,217 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:01,217 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 7fae007a80bb8183f2e1263b83980058/family2 is initiating major compaction (all files) 2023-10-29 15:55:01,217 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:01,217 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:01,218 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 7fae007a80bb8183f2e1263b83980058/family2 in ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:55:01,218 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/47cf967d8a1141429b46b6071eb1b68a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/06dbaee54834495ab26ca4859c3dfe20, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/5596f5c7cced42049e740cdd2f94629a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/8ee2d36beff34bb68039ba6307f44ff9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/360411fcaafe4105bfaa2f7c65ee01de] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp, totalSize=25.3 K 2023-10-29 15:55:01,219 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 47cf967d8a1141429b46b6071eb1b68a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594889664 2023-10-29 15:55:01,219 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 06dbaee54834495ab26ca4859c3dfe20, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594891477 2023-10-29 15:55:01,219 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 5596f5c7cced42049e740cdd2f94629a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594893276 2023-10-29 15:55:01,220 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 8ee2d36beff34bb68039ba6307f44ff9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594894782 2023-10-29 15:55:01,220 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 360411fcaafe4105bfaa2f7c65ee01de, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:01,230 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 7fae007a80bb8183f2e1263b83980058#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:01,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/f8c594e1f31c426f84b49025241563c5, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/981359d410024552b6b32ba230691583, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/df3317800c0a466eb17c1304c2f264ba, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/71aec1296c28430bbe307a3f0817ab57, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/e061526b9b284ca9884d4e404b28e417] to archive 2023-10-29 15:55:01,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:01,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/f8c594e1f31c426f84b49025241563c5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/f8c594e1f31c426f84b49025241563c5 2023-10-29 15:55:01,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/981359d410024552b6b32ba230691583 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/981359d410024552b6b32ba230691583 2023-10-29 15:55:01,270 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/df3317800c0a466eb17c1304c2f264ba to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/df3317800c0a466eb17c1304c2f264ba 2023-10-29 15:55:01,272 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/71aec1296c28430bbe307a3f0817ab57 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/71aec1296c28430bbe307a3f0817ab57 2023-10-29 15:55:01,273 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/e061526b9b284ca9884d4e404b28e417 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/e061526b9b284ca9884d4e404b28e417 2023-10-29 15:55:01,637 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029f339e8981ccc4f6d8af0f25f9ad7f6e8_del 2023-10-29 15:55:01,637 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029f339e8981ccc4f6d8af0f25f9ad7f6e8_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231029f339e8981ccc4f6d8af0f25f9ad7f6e8_del 2023-10-29 15:55:02,466 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32cfec77828248fe9852d83e99cc2423 2023-10-29 15:55:02,467 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/.tmp/family2/32cfec77828248fe9852d83e99cc2423 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/32cfec77828248fe9852d83e99cc2423 2023-10-29 15:55:02,473 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 32cfec77828248fe9852d83e99cc2423 2023-10-29 15:55:02,474 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 7fae007a80bb8183f2e1263b83980058/family2 of 7fae007a80bb8183f2e1263b83980058 into 32cfec77828248fe9852d83e99cc2423(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:55:02,474 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:55:02,481 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:02,486 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:02,489 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:02,490 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:02,496 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 15:55:02,512 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-10-29 15:55:02,515 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029e4b9c69b78ff4c5a8d90982bc2866368_del 2023-10-29 15:55:02,518 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029df77b8ff9c45491cac29a3f8aa864f17_del 2023-10-29 15:55:02,521 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023102964c7fec6f5ca40fc9e78e1ad22d6d536_del 2023-10-29 15:55:02,521 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-10-29 15:55:02,522 DEBUG [Listener at localhost/37167] zookeeper.ReadOnlyZKClient(139): Connect 0x1632c2f4 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:55:02,526 DEBUG [Listener at localhost/37167] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7161b42d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:55:02,527 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 15:55:02,527 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 15:55:02,527 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 15:55:02,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/47cf967d8a1141429b46b6071eb1b68a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/06dbaee54834495ab26ca4859c3dfe20, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/5596f5c7cced42049e740cdd2f94629a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/8ee2d36beff34bb68039ba6307f44ff9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/360411fcaafe4105bfaa2f7c65ee01de] to archive 2023-10-29 15:55:02,561 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:02,563 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/47cf967d8a1141429b46b6071eb1b68a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/47cf967d8a1141429b46b6071eb1b68a 2023-10-29 15:55:02,564 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/06dbaee54834495ab26ca4859c3dfe20 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/06dbaee54834495ab26ca4859c3dfe20 2023-10-29 15:55:02,565 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/5596f5c7cced42049e740cdd2f94629a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/5596f5c7cced42049e740cdd2f94629a 2023-10-29 15:55:02,566 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/8ee2d36beff34bb68039ba6307f44ff9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/8ee2d36beff34bb68039ba6307f44ff9 2023-10-29 15:55:02,567 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/360411fcaafe4105bfaa2f7c65ee01de to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family2/360411fcaafe4105bfaa2f7c65ee01de 2023-10-29 15:55:02,963 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029528356b51c4b4fd288276e5c3bff18d9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231029528356b51c4b4fd288276e5c3bff18d9 2023-10-29 15:55:02,964 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 15:55:02,974 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:55:02,976 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:58830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:55:02,982 DEBUG [MobFileCompactionChore-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:55:02,985 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39610, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:55:02,995 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/28d04746a9534e69a2fd4bf55f40362a first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-10-29 15:55:02,996 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/28d04746a9534e69a2fd4bf55f40362a}] 2023-10-29 15:55:03,002 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/28d04746a9534e69a2fd4bf55f40362a for inclusion in 3572db5871b549a818fbe28bd8653d46/family1 2023-10-29 15:55:03,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-10-29 15:55:03,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 15:55:03,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:55:03,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029/family1/28d04746a9534e69a2fd4bf55f40362a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__1k5858dnlg2gim08d2e8e86ccfdankqu99pi2oumph1sem0ladoojnj86eh289r6/family1/28d04746a9534e69a2fd4bf55f40362a 2023-10-29 15:55:03,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__1k5858dnlg2gim08d2e8e86ccfdankqu99pi2oumph1sem0ladoojnj86eh289r6/family1/28d04746a9534e69a2fd4bf55f40362a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4a6d762659444043aa1ec3841416f7f5_SeqId_28_ 2023-10-29 15:55:03,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__1k5858dnlg2gim08d2e8e86ccfdankqu99pi2oumph1sem0ladoojnj86eh289r6/family1/28d04746a9534e69a2fd4bf55f40362a into 3572db5871b549a818fbe28bd8653d46/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4a6d762659444043aa1ec3841416f7f5_SeqId_28_ - updating store file list. 2023-10-29 15:55:03,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4a6d762659444043aa1ec3841416f7f5_SeqId_28_ into 3572db5871b549a818fbe28bd8653d46/family1 2023-10-29 15:55:03,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__1k5858dnlg2gim08d2e8e86ccfdankqu99pi2oumph1sem0ladoojnj86eh289r6/family1/28d04746a9534e69a2fd4bf55f40362a into 3572db5871b549a818fbe28bd8653d46/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/family1/4a6d762659444043aa1ec3841416f7f5_SeqId_28_) 2023-10-29 15:55:03,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__1k5858dnlg2gim08d2e8e86ccfdankqu99pi2oumph1sem0ladoojnj86eh289r6/family1/28d04746a9534e69a2fd4bf55f40362a 2023-10-29 15:55:03,013 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 15:55:03,013 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:03,014 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023102957d228cfbfec4a6c9c4fb47fcb581a16 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e2023102957d228cfbfec4a6c9c4fb47fcb581a16 2023-10-29 15:55:03,015 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 15:55:03,015 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 15:55:03,015 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 15:55:03,362 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029b4e0d3d6c66649f5b7112fa8ce3221dc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231029b4e0d3d6c66649f5b7112fa8ce3221dc 2023-10-29 15:55:03,363 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 15:55:03,366 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029ac88b87227434829bc9f1d2cd0bbfab4 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029ac88b87227434829bc9f1d2cd0bbfab4 2023-10-29 15:55:03,367 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 15:55:03,391 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/e2da75c746d34c7d934ca4bd7bfe0699 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-10-29 15:55:03,395 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/e2da75c746d34c7d934ca4bd7bfe0699}] 2023-10-29 15:55:03,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/e2da75c746d34c7d934ca4bd7bfe0699 for inclusion in 7fae007a80bb8183f2e1263b83980058/family1 2023-10-29 15:55:03,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-10-29 15:55:03,400 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/40b88cf432c6445c8b7850024512d411 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-10-29 15:55:03,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 15:55:03,401 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/40b88cf432c6445c8b7850024512d411}] 2023-10-29 15:55:03,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:55:03,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029/family1/e2da75c746d34c7d934ca4bd7bfe0699 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__t16pk700j6kc6lbsvpglrmtn9kocgomnif41lboftjl4o0bh2ise4ehbud3ksrkj/family1/e2da75c746d34c7d934ca4bd7bfe0699 2023-10-29 15:55:03,403 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/40b88cf432c6445c8b7850024512d411 for inclusion in 99df69438d2ae3350f006d99e0fba202/family1 2023-10-29 15:55:03,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__t16pk700j6kc6lbsvpglrmtn9kocgomnif41lboftjl4o0bh2ise4ehbud3ksrkj/family1/e2da75c746d34c7d934ca4bd7bfe0699 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/99d8518e377145bcbdcecba1d39072c5_SeqId_28_ 2023-10-29 15:55:03,405 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__t16pk700j6kc6lbsvpglrmtn9kocgomnif41lboftjl4o0bh2ise4ehbud3ksrkj/family1/e2da75c746d34c7d934ca4bd7bfe0699 into 7fae007a80bb8183f2e1263b83980058/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/99d8518e377145bcbdcecba1d39072c5_SeqId_28_ - updating store file list. 2023-10-29 15:55:03,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-10-29 15:55:03,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 15:55:03,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:55:03,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029/family1/40b88cf432c6445c8b7850024512d411 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__aosce6ein0bg8ajq8u2vggmj0q8ncutm2on013ncn15kn2071gc49dbg0rrdv48c/family1/40b88cf432c6445c8b7850024512d411 2023-10-29 15:55:03,417 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:55:03,417 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x035cd9e1 to 127.0.0.1:62629 2023-10-29 15:55:03,417 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:03,417 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:55:03,417 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2edae06c to 127.0.0.1:62629 2023-10-29 15:55:03,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/99d8518e377145bcbdcecba1d39072c5_SeqId_28_ into 7fae007a80bb8183f2e1263b83980058/family1 2023-10-29 15:55:03,417 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__t16pk700j6kc6lbsvpglrmtn9kocgomnif41lboftjl4o0bh2ise4ehbud3ksrkj/family1/e2da75c746d34c7d934ca4bd7bfe0699 into 7fae007a80bb8183f2e1263b83980058/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/family1/99d8518e377145bcbdcecba1d39072c5_SeqId_28_) 2023-10-29 15:55:03,417 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:03,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__t16pk700j6kc6lbsvpglrmtn9kocgomnif41lboftjl4o0bh2ise4ehbud3ksrkj/family1/e2da75c746d34c7d934ca4bd7bfe0699 2023-10-29 15:55:03,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__aosce6ein0bg8ajq8u2vggmj0q8ncutm2on013ncn15kn2071gc49dbg0rrdv48c/family1/40b88cf432c6445c8b7850024512d411 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ce3b8c751e7b4359ae9569407519ead8_SeqId_28_ 2023-10-29 15:55:03,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__aosce6ein0bg8ajq8u2vggmj0q8ncutm2on013ncn15kn2071gc49dbg0rrdv48c/family1/40b88cf432c6445c8b7850024512d411 into 99df69438d2ae3350f006d99e0fba202/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ce3b8c751e7b4359ae9569407519ead8_SeqId_28_ - updating store file list. 2023-10-29 15:55:03,419 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 15:55:03,420 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:03,421 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023102910ab7ea3e0a94d8791b9c418adda369c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023102910ab7ea3e0a94d8791b9c418adda369c 2023-10-29 15:55:03,421 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 15:55:03,421 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 15:55:03,421 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 15:55:03,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ce3b8c751e7b4359ae9569407519ead8_SeqId_28_ into 99df69438d2ae3350f006d99e0fba202/family1 2023-10-29 15:55:03,421 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__aosce6ein0bg8ajq8u2vggmj0q8ncutm2on013ncn15kn2071gc49dbg0rrdv48c/family1/40b88cf432c6445c8b7850024512d411 into 99df69438d2ae3350f006d99e0fba202/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/family1/ce3b8c751e7b4359ae9569407519ead8_SeqId_28_) 2023-10-29 15:55:03,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__ns_testMinorCompaction__aosce6ein0bg8ajq8u2vggmj0q8ncutm2on013ncn15kn2071gc49dbg0rrdv48c/family1/40b88cf432c6445c8b7850024512d411 2023-10-29 15:55:03,423 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='ns:testMinorCompaction' column='family1' 2023-10-29 15:55:03,423 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:03,424 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029afadd907d15d4c8e8b0e70abba2e4629 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231029afadd907d15d4c8e8b0e70abba2e4629 2023-10-29 15:55:03,424 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-10-29 15:55:03,424 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 15:55:03,425 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='ns:testMinorCompaction' and column='family1' 2023-10-29 15:55:03,425 INFO [Listener at localhost/37167] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-10-29 15:55:03,426 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:03,428 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:03,431 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:03,432 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:03,448 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=258 (was 289), OpenFileDescriptor=647 (was 759), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 162) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=2607 (was 2640) 2023-10-29 15:55:03,460 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=258, OpenFileDescriptor=647, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=167, AvailableMemoryMB=2607 2023-10-29 15:55:03,462 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-10-29 15:55:03,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:03,464 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:55:03,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-10-29 15:55:03,465 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:55:03,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 15:55:03,466 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:03,467 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc empty. 2023-10-29 15:55:03,467 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:03,467 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-10-29 15:55:03,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 15:55:03,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 15:55:03,876 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-10-29 15:55:03,879 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => b1d03b3a7ea1f70fe02ec0f522ed00bc, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:55:04,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 15:55:04,291 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:55:04,291 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing b1d03b3a7ea1f70fe02ec0f522ed00bc, disabling compactions & flushes 2023-10-29 15:55:04,291 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:04,291 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:04,291 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. after waiting 0 ms 2023-10-29 15:55:04,291 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:04,292 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:04,292 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:04,297 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:55:04,299 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698594904299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594904299"}]},"ts":"1698594904299"} 2023-10-29 15:55:04,301 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-10-29 15:55:04,302 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:55:04,302 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594904302"}]},"ts":"1698594904302"} 2023-10-29 15:55:04,303 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-10-29 15:55:04,305 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=b1d03b3a7ea1f70fe02ec0f522ed00bc, ASSIGN}] 2023-10-29 15:55:04,306 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=b1d03b3a7ea1f70fe02ec0f522ed00bc, ASSIGN 2023-10-29 15:55:04,307 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=b1d03b3a7ea1f70fe02ec0f522ed00bc, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:55:04,459 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=b1d03b3a7ea1f70fe02ec0f522ed00bc, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:04,459 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698594904458"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594904458"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594904458"}]},"ts":"1698594904458"} 2023-10-29 15:55:04,461 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure b1d03b3a7ea1f70fe02ec0f522ed00bc, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:55:04,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 15:55:04,615 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:04,623 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:04,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b1d03b3a7ea1f70fe02ec0f522ed00bc, NAME => 'testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc.', STARTKEY => '', ENDKEY => ''} 2023-10-29 15:55:04,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:04,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:55:04,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:04,625 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:04,630 INFO [StoreOpener-b1d03b3a7ea1f70fe02ec0f522ed00bc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:04,632 DEBUG [StoreOpener-b1d03b3a7ea1f70fe02ec0f522ed00bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 2023-10-29 15:55:04,632 DEBUG [StoreOpener-b1d03b3a7ea1f70fe02ec0f522ed00bc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 2023-10-29 15:55:04,633 INFO [StoreOpener-b1d03b3a7ea1f70fe02ec0f522ed00bc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b1d03b3a7ea1f70fe02ec0f522ed00bc columnFamilyName family1 2023-10-29 15:55:04,634 INFO [StoreOpener-b1d03b3a7ea1f70fe02ec0f522ed00bc-1] regionserver.HStore(310): Store=b1d03b3a7ea1f70fe02ec0f522ed00bc/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:55:04,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:04,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:04,640 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:04,642 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:55:04,643 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened b1d03b3a7ea1f70fe02ec0f522ed00bc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59142539, jitterRate=-0.11870749294757843}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-10-29 15:55:04,643 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:04,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc., pid=114, masterSystemTime=1698594904615 2023-10-29 15:55:04,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:04,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:04,646 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=b1d03b3a7ea1f70fe02ec0f522ed00bc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:04,646 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1698594904646"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594904646"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594904646"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594904646"}]},"ts":"1698594904646"} 2023-10-29 15:55:04,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=114, resume processing ppid=113 2023-10-29 15:55:04,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure b1d03b3a7ea1f70fe02ec0f522ed00bc, server=jenkins-hbase20.apache.org,44603,1698594767651 in 187 msec 2023-10-29 15:55:04,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=113, resume processing ppid=112 2023-10-29 15:55:04,651 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=b1d03b3a7ea1f70fe02ec0f522ed00bc, ASSIGN in 344 msec 2023-10-29 15:55:04,651 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:55:04,651 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594904651"}]},"ts":"1698594904651"} 2023-10-29 15:55:04,653 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-10-29 15:55:04,654 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:55:04,655 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1920 sec 2023-10-29 15:55:05,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-10-29 15:55:05,575 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-10-29 15:55:05,596 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:05,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:05,597 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:05,597 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:05,597 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:05,597 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:05,598 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:05,598 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:05,598 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:05,598 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:05,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:05,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:05,599 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:05,599 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:05,599 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:05,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:05,599 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:05,599 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:05,600 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:05,600 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:05,600 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:05,600 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:05,600 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:05,600 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:05,600 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:05,601 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-10-29 15:55:05,626 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511306a2f291d46ba4808b82ec2899069ec73 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306a2f291d46ba4808b82ec2899069ec73 2023-10-29 15:55:06,030 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/8aeab85e441f4c658f49c98729fd5d33 2023-10-29 15:55:06,043 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/8aeab85e441f4c658f49c98729fd5d33 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/8aeab85e441f4c658f49c98729fd5d33 2023-10-29 15:55:06,049 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/8aeab85e441f4c658f49c98729fd5d33, entries=1000, sequenceid=5, filesize=166.0 K 2023-10-29 15:55:06,050 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 449ms, sequenceid=5, compaction requested=false 2023-10-29 15:55:06,050 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:06,050 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:06,050 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:06,051 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:06,051 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:06,051 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,051 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:06,051 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:06,052 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,052 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:06,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:06,053 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,053 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:06,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:06,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:06,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:06,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:06,055 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bc142aa[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:06,055 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:06,055 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,056 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,056 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,057 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:06,057 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:06,057 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:06,057 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,057 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:06,058 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,058 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:06,058 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:06,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:06,058 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:06,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:06,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:06,062 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:06,062 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:06,062 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:06,062 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:06,062 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,062 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:06,063 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:06,063 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,063 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:06,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:06,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:06,063 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,064 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:06,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,065 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,065 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:06,065 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:06,065 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:06,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:06,066 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,066 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:06,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:06,066 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,066 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,066 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:06,066 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,066 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:06,066 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:06,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:06,166 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:06,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:06,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:06,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:06,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,175 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:06,175 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:06,175 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:06,175 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:06,175 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,176 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,176 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:06,176 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:06,177 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,177 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:06,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,178 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:06,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,179 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,179 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:06,179 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,179 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:06,179 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:06,179 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:06,180 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:06,180 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:06,180 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:06,180 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:06,180 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=74 B heapSize=408 B 2023-10-29 15:55:06,602 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284b67576ac503449697cd1b7cd28f2eb7 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511284b67576ac503449697cd1b7cd28f2eb7 2023-10-29 15:55:06,609 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/56fbadde802a41e59b3d60dcb2d0a9f9 2023-10-29 15:55:06,614 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/56fbadde802a41e59b3d60dcb2d0a9f9 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/56fbadde802a41e59b3d60dcb2d0a9f9 2023-10-29 15:55:06,620 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/56fbadde802a41e59b3d60dcb2d0a9f9, entries=1, sequenceid=9, filesize=5.0 K 2023-10-29 15:55:06,621 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 441ms, sequenceid=9, compaction requested=false 2023-10-29 15:55:06,621 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:06,621 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:06,621 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:06,621 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:06,621 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,621 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:06,621 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:06,623 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,623 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:06,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:06,623 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,624 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:06,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:06,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:06,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:06,626 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2365301[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:06,626 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:06,626 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,627 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,628 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:06,628 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:06,628 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:06,628 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,628 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:06,630 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:06,630 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:06,630 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,630 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:06,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:06,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:06,634 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:06,634 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:06,634 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:06,634 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:06,634 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,635 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:06,644 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,644 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:06,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,644 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:06,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:06,644 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:06,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,645 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:06,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,651 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:06,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:06,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:06,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:06,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,651 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:06,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:06,751 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:06,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:06,759 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:06,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:06,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,762 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:06,762 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:06,762 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:06,762 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:06,763 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,764 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,765 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:06,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:06,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:06,765 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,766 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:06,766 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:06,766 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:06,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,767 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,767 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:06,767 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:06,767 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:06,767 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:06,767 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:06,768 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:06,768 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:06,768 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:06,768 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:06,768 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:55:07,183 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512013a6a1baae62d4035a50eeb7932bde88e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013a6a1baae62d4035a50eeb7932bde88e 2023-10-29 15:55:07,591 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/40487aaaefee496ba7a07a41d4c27fbd 2023-10-29 15:55:07,604 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/40487aaaefee496ba7a07a41d4c27fbd as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/40487aaaefee496ba7a07a41d4c27fbd 2023-10-29 15:55:07,609 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/40487aaaefee496ba7a07a41d4c27fbd, entries=1, sequenceid=13, filesize=4.9 K 2023-10-29 15:55:07,609 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 841ms, sequenceid=13, compaction requested=true 2023-10-29 15:55:07,610 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:07,610 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:07,610 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:07,610 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:07,610 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,610 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:07,610 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:07,612 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,612 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:07,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:07,612 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,612 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:07,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:07,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:07,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:07,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:07,615 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@e91a3d0[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:07,615 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:07,615 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,616 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,616 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:07,616 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:07,616 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:07,616 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,616 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:07,617 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:07,617 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,617 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:07,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:07,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:07,617 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:07,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:07,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:07,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:07,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:07,621 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:07,621 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:07,621 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:07,621 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:07,621 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,621 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:07,623 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,623 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:07,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:07,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,623 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:07,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:07,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:07,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:07,623 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:07,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,625 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:07,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,628 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:07,628 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,628 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:07,628 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:07,628 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:07,628 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:07,629 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:07,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:07,628 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,629 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,629 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,629 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,629 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,629 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:07,629 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:07,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:07,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:07,729 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:07,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:07,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:07,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:07,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,742 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:07,742 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:07,742 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:07,742 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:07,743 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,743 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,743 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,743 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:07,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:07,744 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:07,744 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:07,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,744 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:07,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,745 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,745 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:07,745 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:07,745 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:07,745 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:07,745 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:07,745 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:07,745 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:07,745 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:07,745 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:07,746 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:55:08,163 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120509f85ed5467245d2afcd11412bad0160 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120509f85ed5467245d2afcd11412bad0160 2023-10-29 15:55:08,574 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/aea4df7692b6434fb9721c0674426219 2023-10-29 15:55:08,587 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/aea4df7692b6434fb9721c0674426219 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/aea4df7692b6434fb9721c0674426219 2023-10-29 15:55:08,594 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/aea4df7692b6434fb9721c0674426219, entries=1, sequenceid=17, filesize=4.9 K 2023-10-29 15:55:08,595 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 849ms, sequenceid=17, compaction requested=true 2023-10-29 15:55:08,596 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:08,596 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:08,596 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:08,596 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:08,596 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,596 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:08,596 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:08,598 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:08,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:08,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:08,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:08,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:08,601 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:08,601 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,601 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2b8c9ce0[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:08,602 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,602 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:08,602 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,602 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:08,602 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:08,602 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:08,603 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:08,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:08,603 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:08,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:08,605 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:08,605 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:08,606 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:08,606 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:08,606 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,606 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:08,607 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,607 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:08,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,607 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:08,607 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,607 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:08,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:08,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,608 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,611 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,611 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:08,611 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:08,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:55:08,611 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:08,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:08,611 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:08,612 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:08,611 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,611 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:08,612 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,612 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,612 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,612 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,612 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:08,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:08,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:08,612 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:08,712 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:08,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:08,717 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:08,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:08,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,718 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:08,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:08,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:08,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:08,718 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,719 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,719 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:08,719 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:08,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:08,720 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:08,720 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,720 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:08,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,720 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,720 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:08,720 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:08,720 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:08,720 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:08,720 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:08,720 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:08,720 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:08,721 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:08,721 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:08,721 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:55:09,130 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512281ddc32ac3c4045988b7bd657921f24e3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281ddc32ac3c4045988b7bd657921f24e3 2023-10-29 15:55:09,535 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/519f4e767a0c45e280abf13eba575b9a 2023-10-29 15:55:09,539 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/519f4e767a0c45e280abf13eba575b9a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/519f4e767a0c45e280abf13eba575b9a 2023-10-29 15:55:09,543 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/519f4e767a0c45e280abf13eba575b9a, entries=1, sequenceid=21, filesize=4.9 K 2023-10-29 15:55:09,544 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 823ms, sequenceid=21, compaction requested=true 2023-10-29 15:55:09,544 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:09,544 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:09,544 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:09,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:09,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:09,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:09,546 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,546 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:09,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:09,546 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,546 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:09,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:09,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:09,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:09,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:09,549 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a894f29[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:09,549 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:09,549 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,550 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:09,550 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:09,550 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:09,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:09,551 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:09,551 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,551 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:09,551 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:09,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:09,554 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:09,554 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:09,554 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:09,554 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:09,554 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,554 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:09,561 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,561 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,561 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:09,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:09,561 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:09,562 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:09,562 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:09,562 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:09,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,564 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:09,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,564 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,565 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,565 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:09,565 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:09,566 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:09,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:09,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:09,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:09,566 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:09,566 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,566 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:09,566 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:09,566 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,566 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:09,566 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:09,566 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,566 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,567 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,667 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:09,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:09,671 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:09,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:09,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,672 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:09,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:09,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:09,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:09,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,673 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,673 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:09,673 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,673 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:09,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:09,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:09,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:09,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,674 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:09,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,675 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,675 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:09,675 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:09,675 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:09,675 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:09,675 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:09,676 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:09,676 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:09,676 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:09,676 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:09,676 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:55:09,687 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231b8d7aeca782c46d1b03c1542b417a1f3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231b8d7aeca782c46d1b03c1542b417a1f3 2023-10-29 15:55:10,094 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/2fdd4fd2f8a2435e9c9e3f5936a0afda 2023-10-29 15:55:10,107 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/2fdd4fd2f8a2435e9c9e3f5936a0afda as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/2fdd4fd2f8a2435e9c9e3f5936a0afda 2023-10-29 15:55:10,112 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/2fdd4fd2f8a2435e9c9e3f5936a0afda, entries=1, sequenceid=25, filesize=4.9 K 2023-10-29 15:55:10,112 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 436ms, sequenceid=25, compaction requested=true 2023-10-29 15:55:10,113 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:10,113 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:10,113 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:10,113 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:10,113 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,113 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:10,113 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:10,114 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,114 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:10,114 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,114 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:10,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:10,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4a97b522[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:10,116 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:10,116 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,116 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,117 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:10,117 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:10,117 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:10,117 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,117 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:10,118 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:10,118 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:10,118 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,118 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:10,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:10,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:10,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:10,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:10,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:10,122 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:10,122 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:10,122 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:10,122 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,122 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:10,124 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,124 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:10,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:10,124 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:10,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:10,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:10,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:10,124 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:10,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,126 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:10,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,128 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:10,128 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:10,128 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:10,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:10,129 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:10,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:10,160 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:55:10,229 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:10,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:10,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:10,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:10,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,235 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:10,235 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:10,235 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:10,235 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:10,235 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,235 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,236 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:10,236 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:10,236 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:10,236 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:10,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,237 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,237 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:10,237 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:10,237 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:10,237 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:10,237 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:10,237 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:10,237 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:10,237 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:10,237 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:10,237 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:55:10,657 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601018a6004f858c241e88457681c1d06ab12 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6004f858c241e88457681c1d06ab12 2023-10-29 15:55:11,065 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/900de14edd2f48728e8bdccc1bf2d4ad 2023-10-29 15:55:11,076 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/900de14edd2f48728e8bdccc1bf2d4ad as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/900de14edd2f48728e8bdccc1bf2d4ad 2023-10-29 15:55:11,082 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/900de14edd2f48728e8bdccc1bf2d4ad, entries=1, sequenceid=29, filesize=4.9 K 2023-10-29 15:55:11,083 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 846ms, sequenceid=29, compaction requested=true 2023-10-29 15:55:11,084 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:11,084 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:11,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:11,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:11,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:11,084 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:11,085 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,086 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:11,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,086 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:11,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:11,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:11,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@491b0083[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:11,089 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:11,089 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,090 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:11,090 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:11,090 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,090 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:11,092 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,092 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:11,092 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:11,092 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:11,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:11,096 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:11,096 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:11,096 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:11,096 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,096 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:11,098 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,098 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:11,098 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,099 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,099 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:11,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,101 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,103 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,103 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,103 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:11,103 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:11,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:11,103 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:11,104 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:11,103 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:11,103 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:11,103 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:55:11,104 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:11,104 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:11,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:11,104 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,104 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:11,104 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,205 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:11,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:11,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:11,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:11,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,218 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:11,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:11,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:11,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:11,218 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,219 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,220 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:11,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,220 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:11,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:11,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:11,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,220 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:11,220 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:11,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,221 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,221 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:11,221 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:11,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:11,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:11,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:11,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:11,221 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:11,221 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:11,221 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:11,221 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:55:11,639 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034ea41ec03e2c4801bab577349f9b2713 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034ea41ec03e2c4801bab577349f9b2713 2023-10-29 15:55:12,047 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/1e80c04e7586412bb4226a312ddc5873 2023-10-29 15:55:12,054 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/1e80c04e7586412bb4226a312ddc5873 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/1e80c04e7586412bb4226a312ddc5873 2023-10-29 15:55:12,061 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/1e80c04e7586412bb4226a312ddc5873, entries=1, sequenceid=33, filesize=4.9 K 2023-10-29 15:55:12,062 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 841ms, sequenceid=33, compaction requested=true 2023-10-29 15:55:12,062 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:12,062 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:12,062 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:12,062 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:12,062 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,062 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:12,063 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:12,064 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,064 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:12,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:12,065 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,065 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:12,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:12,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:12,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:12,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:12,068 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6bfeedc[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:12,068 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:12,069 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,070 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,070 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,070 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:12,070 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:12,070 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:12,070 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,070 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:12,073 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,073 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:12,073 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:12,074 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:12,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:12,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:12,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:12,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:12,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:12,078 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:12,079 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:12,079 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:12,079 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:12,079 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,079 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:12,082 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,082 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,082 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:12,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:12,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:12,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:12,084 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:12,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,086 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:12,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,090 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,090 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,090 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,090 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:12,090 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:12,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:12,091 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:12,091 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,091 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:12,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:12,091 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:12,091 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:12,092 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:12,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:55:12,092 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:12,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:12,091 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,092 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,092 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,192 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:12,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:12,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:12,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:12,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,204 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:12,204 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:12,205 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:12,205 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:12,206 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,206 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,207 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:12,207 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:12,208 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,208 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:12,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,210 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,210 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:12,210 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,210 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:12,210 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:12,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:12,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:12,211 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:12,211 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:12,211 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:12,211 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:55:12,622 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c336daaa7695445d98bbe3dabe96acbc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20150907c336daaa7695445d98bbe3dabe96acbc 2023-10-29 15:55:12,627 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/7388f8c008b44bd692de791c2bdd87a8 2023-10-29 15:55:12,643 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/7388f8c008b44bd692de791c2bdd87a8 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/7388f8c008b44bd692de791c2bdd87a8 2023-10-29 15:55:12,647 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/7388f8c008b44bd692de791c2bdd87a8, entries=1, sequenceid=37, filesize=4.9 K 2023-10-29 15:55:12,648 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 437ms, sequenceid=37, compaction requested=true 2023-10-29 15:55:12,649 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:12,649 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:12,649 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:12,649 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:12,649 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,649 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:12,649 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:12,650 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,650 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:12,650 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:12,650 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:12,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:12,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:12,651 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@367f1925[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:12,651 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:12,651 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,652 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,652 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:12,652 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:12,652 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:12,652 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,652 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:12,653 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:12,653 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,653 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:12,653 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:12,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:12,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:12,655 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:12,655 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:12,655 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:12,655 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:12,655 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,655 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:12,656 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,656 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:12,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:12,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,656 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:12,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:12,656 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:12,656 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,657 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:12,659 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:12,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:12,659 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:12,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-10-29 15:55:12,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:12,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:12,659 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,660 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,660 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,760 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:12,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:12,765 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:12,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:12,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,766 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:12,766 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:12,766 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-10-29 15:55:12,766 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-10-29 15:55:12,767 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,767 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,768 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:12,768 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:12,768 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:12,768 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,768 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:12,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,768 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,769 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-10-29 15:55:12,769 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:12,769 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-10-29 15:55:12,769 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:12,769 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-10-29 15:55:12,769 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-10-29 15:55:12,769 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:12,769 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:12,769 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. started... 2023-10-29 15:55:12,769 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing b1d03b3a7ea1f70fe02ec0f522ed00bc 1/1 column families, dataSize=73 B heapSize=408 B 2023-10-29 15:55:13,181 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120233ddd7a45f041bdbf816e0e0f6a3533 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120233ddd7a45f041bdbf816e0e0f6a3533 2023-10-29 15:55:13,586 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/9bc3602ed4dc481d88d339be500a1559 2023-10-29 15:55:13,590 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/9bc3602ed4dc481d88d339be500a1559 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9bc3602ed4dc481d88d339be500a1559 2023-10-29 15:55:13,593 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9bc3602ed4dc481d88d339be500a1559, entries=1, sequenceid=41, filesize=4.9 K 2023-10-29 15:55:13,594 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for b1d03b3a7ea1f70fe02ec0f522ed00bc in 825ms, sequenceid=41, compaction requested=true 2023-10-29 15:55:13,594 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:13,594 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:13,594 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-10-29 15:55:13,594 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-10-29 15:55:13,594 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,594 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-10-29 15:55:13,594 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-10-29 15:55:13,595 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,595 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:13,596 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,596 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:13,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-10-29 15:55:13,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4136846d[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:13,597 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-10-29 15:55:13,597 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,597 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-10-29 15:55:13,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-10-29 15:55:13,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:13,598 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,598 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:13,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-10-29 15:55:13,598 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:13,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:13,598 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-10-29 15:55:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:13,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-10-29 15:55:13,600 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-10-29 15:55:13,600 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:13,600 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:13,600 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,600 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:13,601 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,601 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:13,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,601 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:13,601 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:13,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:13,602 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,602 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:13,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:13,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-10-29 15:55:13,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:13,604 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:13,604 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:13,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:13,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:13,704 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:13,705 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:13,706 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-10-29 15:55:13,707 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:55:13,708 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:55:13,709 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:55:13,709 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595513709 2023-10-29 15:55:13,711 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-10-29 15:55:13,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-10-29 15:55:13,712 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:55:13,713 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x7b407dd4 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:55:13,718 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d34ac21, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:55:13,718 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:55:14,146 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601035414e981cc254f41916f9305939a1963 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601035414e981cc254f41916f9305939a1963 2023-10-29 15:55:14,147 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:55:14,162 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:55:14,164 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:51258, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:55:14,168 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:55:14,169 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60386, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:55:14,179 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ab400d6af82d4d1ca71471a9843414c1 first=Optional[r5] last=Optional[r6] 2023-10-29 15:55:14,180 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ab400d6af82d4d1ca71471a9843414c1}] 2023-10-29 15:55:14,184 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ab400d6af82d4d1ca71471a9843414c1 for inclusion in b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 2023-10-29 15:55:14,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-10-29 15:55:14,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:55:14,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:14,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/ab400d6af82d4d1ca71471a9843414c1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q94lgv2pasnnop4bra9cngevpij372ubdv8bmkha82d7ikjnihnoc3l1rftpv24f/family1/ab400d6af82d4d1ca71471a9843414c1 2023-10-29 15:55:14,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q94lgv2pasnnop4bra9cngevpij372ubdv8bmkha82d7ikjnihnoc3l1rftpv24f/family1/ab400d6af82d4d1ca71471a9843414c1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/606dabb727644c8880779dcdf3ad566a_SeqId_44_ 2023-10-29 15:55:14,189 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q94lgv2pasnnop4bra9cngevpij372ubdv8bmkha82d7ikjnihnoc3l1rftpv24f/family1/ab400d6af82d4d1ca71471a9843414c1 into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/606dabb727644c8880779dcdf3ad566a_SeqId_44_ - updating store file list. 2023-10-29 15:55:14,192 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/606dabb727644c8880779dcdf3ad566a_SeqId_44_ into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 2023-10-29 15:55:14,192 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q94lgv2pasnnop4bra9cngevpij372ubdv8bmkha82d7ikjnihnoc3l1rftpv24f/family1/ab400d6af82d4d1ca71471a9843414c1 into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/606dabb727644c8880779dcdf3ad566a_SeqId_44_) 2023-10-29 15:55:14,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__q94lgv2pasnnop4bra9cngevpij372ubdv8bmkha82d7ikjnihnoc3l1rftpv24f/family1/ab400d6af82d4d1ca71471a9843414c1 2023-10-29 15:55:14,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-10-29 15:55:14,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-10-29 15:55:14,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(1912): b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 is initiating minor compaction 2023-10-29 15:55:14,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@1db74263; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 15:55:14,195 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2259): Starting compaction of b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 in testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:14,195 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/56fbadde802a41e59b3d60dcb2d0a9f9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/40487aaaefee496ba7a07a41d4c27fbd, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/aea4df7692b6434fb9721c0674426219, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/519f4e767a0c45e280abf13eba575b9a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/2fdd4fd2f8a2435e9c9e3f5936a0afda, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/900de14edd2f48728e8bdccc1bf2d4ad, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/1e80c04e7586412bb4226a312ddc5873, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/7388f8c008b44bd692de791c2bdd87a8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9bc3602ed4dc481d88d339be500a1559, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/606dabb727644c8880779dcdf3ad566a_SeqId_44_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp, totalSize=49.7 K 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 56fbadde802a41e59b3d60dcb2d0a9f9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 40487aaaefee496ba7a07a41d4c27fbd, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting aea4df7692b6434fb9721c0674426219, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 519f4e767a0c45e280abf13eba575b9a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 2fdd4fd2f8a2435e9c9e3f5936a0afda, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 900de14edd2f48728e8bdccc1bf2d4ad, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 1e80c04e7586412bb4226a312ddc5873, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 7388f8c008b44bd692de791c2bdd87a8, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 9bc3602ed4dc481d88d339be500a1559, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-10-29 15:55:14,196 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] compactions.Compactor(207): Compacting 606dabb727644c8880779dcdf3ad566a_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-10-29 15:55:14,197 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:55:14,197 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:14,198 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6004f858c241e88457681c1d06ab12 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601018a6004f858c241e88457681c1d06ab12 2023-10-29 15:55:14,199 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034ea41ec03e2c4801bab577349f9b2713 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601034ea41ec03e2c4801bab577349f9b2713 2023-10-29 15:55:14,199 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-10-29 15:55:14,199 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-10-29 15:55:14,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:55:14,200 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:55:14,220 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] throttle.PressureAwareThroughputController(145): b1d03b3a7ea1f70fe02ec0f522ed00bc#family1#compaction#164 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 15:55:15,036 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/9f242043b6954c85bbc751c5cd4b6832 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9f242043b6954c85bbc751c5cd4b6832 2023-10-29 15:55:15,041 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 of b1d03b3a7ea1f70fe02ec0f522ed00bc into 9f242043b6954c85bbc751c5cd4b6832(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:55:15,041 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:15,041 INFO [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1698594914195; duration=0sec 2023-10-29 15:55:15,041 DEBUG [RS:0;jenkins-hbase20:44603-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:55:15,047 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512319a2dd57502e24498ba2a25c009f13cb2 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512319a2dd57502e24498ba2a25c009f13cb2 2023-10-29 15:55:15,048 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:55:15,062 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/56fbadde802a41e59b3d60dcb2d0a9f9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/40487aaaefee496ba7a07a41d4c27fbd, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/aea4df7692b6434fb9721c0674426219, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/519f4e767a0c45e280abf13eba575b9a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/2fdd4fd2f8a2435e9c9e3f5936a0afda, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/900de14edd2f48728e8bdccc1bf2d4ad, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/1e80c04e7586412bb4226a312ddc5873, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/7388f8c008b44bd692de791c2bdd87a8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9bc3602ed4dc481d88d339be500a1559, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/606dabb727644c8880779dcdf3ad566a_SeqId_44_] to archive 2023-10-29 15:55:15,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:15,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/56fbadde802a41e59b3d60dcb2d0a9f9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/56fbadde802a41e59b3d60dcb2d0a9f9 2023-10-29 15:55:15,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/40487aaaefee496ba7a07a41d4c27fbd to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/40487aaaefee496ba7a07a41d4c27fbd 2023-10-29 15:55:15,069 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/aea4df7692b6434fb9721c0674426219 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/aea4df7692b6434fb9721c0674426219 2023-10-29 15:55:15,070 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/519f4e767a0c45e280abf13eba575b9a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/519f4e767a0c45e280abf13eba575b9a 2023-10-29 15:55:15,070 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1bb73219875949baab94fdc15b0c94d0 first=Optional[r1] last=Optional[r4] 2023-10-29 15:55:15,071 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1bb73219875949baab94fdc15b0c94d0}] 2023-10-29 15:55:15,071 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/2fdd4fd2f8a2435e9c9e3f5936a0afda to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/2fdd4fd2f8a2435e9c9e3f5936a0afda 2023-10-29 15:55:15,072 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/900de14edd2f48728e8bdccc1bf2d4ad to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/900de14edd2f48728e8bdccc1bf2d4ad 2023-10-29 15:55:15,073 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1bb73219875949baab94fdc15b0c94d0 for inclusion in b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 2023-10-29 15:55:15,073 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/1e80c04e7586412bb4226a312ddc5873 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/1e80c04e7586412bb4226a312ddc5873 2023-10-29 15:55:15,074 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/7388f8c008b44bd692de791c2bdd87a8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/7388f8c008b44bd692de791c2bdd87a8 2023-10-29 15:55:15,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-10-29 15:55:15,075 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9bc3602ed4dc481d88d339be500a1559 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9bc3602ed4dc481d88d339be500a1559 2023-10-29 15:55:15,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:55:15,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:15,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/1bb73219875949baab94fdc15b0c94d0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__90513410r29str8ueu317rgp9360vog2a0nrf4uogsr3hkqtuoqu45dq6r7ds408/family1/1bb73219875949baab94fdc15b0c94d0 2023-10-29 15:55:15,076 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/606dabb727644c8880779dcdf3ad566a_SeqId_44_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/606dabb727644c8880779dcdf3ad566a_SeqId_44_ 2023-10-29 15:55:15,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__90513410r29str8ueu317rgp9360vog2a0nrf4uogsr3hkqtuoqu45dq6r7ds408/family1/1bb73219875949baab94fdc15b0c94d0 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/3b21f0c04a6f44a2b373822e91735074_SeqId_47_ 2023-10-29 15:55:15,077 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__90513410r29str8ueu317rgp9360vog2a0nrf4uogsr3hkqtuoqu45dq6r7ds408/family1/1bb73219875949baab94fdc15b0c94d0 into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/3b21f0c04a6f44a2b373822e91735074_SeqId_47_ - updating store file list. 2023-10-29 15:55:15,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/3b21f0c04a6f44a2b373822e91735074_SeqId_47_ into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 2023-10-29 15:55:15,080 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__90513410r29str8ueu317rgp9360vog2a0nrf4uogsr3hkqtuoqu45dq6r7ds408/family1/1bb73219875949baab94fdc15b0c94d0 into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/3b21f0c04a6f44a2b373822e91735074_SeqId_47_) 2023-10-29 15:55:15,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__90513410r29str8ueu317rgp9360vog2a0nrf4uogsr3hkqtuoqu45dq6r7ds408/family1/1bb73219875949baab94fdc15b0c94d0 2023-10-29 15:55:15,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-10-29 15:55:15,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-10-29 15:55:15,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(1912): b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 is initiating minor compaction (all files) 2023-10-29 15:55:15,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2a73ec78; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-10-29 15:55:15,081 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 in testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:15,082 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/8aeab85e441f4c658f49c98729fd5d33, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9f242043b6954c85bbc751c5cd4b6832, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/3b21f0c04a6f44a2b373822e91735074_SeqId_47_] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp, totalSize=178.1 K 2023-10-29 15:55:15,082 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 8aeab85e441f4c658f49c98729fd5d33, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878851783 2023-10-29 15:55:15,082 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 9f242043b6954c85bbc751c5cd4b6832, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621251783 2023-10-29 15:55:15,083 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] compactions.Compactor(207): Compacting 3b21f0c04a6f44a2b373822e91735074_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965251783 2023-10-29 15:55:15,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:55:15,084 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:15,085 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013a6a1baae62d4035a50eeb7932bde88e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512013a6a1baae62d4035a50eeb7932bde88e 2023-10-29 15:55:15,086 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120509f85ed5467245d2afcd11412bad0160 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120509f85ed5467245d2afcd11412bad0160 2023-10-29 15:55:15,087 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281ddc32ac3c4045988b7bd657921f24e3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512281ddc32ac3c4045988b7bd657921f24e3 2023-10-29 15:55:15,088 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231b8d7aeca782c46d1b03c1542b417a1f3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231b8d7aeca782c46d1b03c1542b417a1f3 2023-10-29 15:55:15,088 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-10-29 15:55:15,088 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-10-29 15:55:15,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:55:15,089 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:55:15,096 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] throttle.PressureAwareThroughputController(145): b1d03b3a7ea1f70fe02ec0f522ed00bc#family1#compaction#165 average throughput is 19.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-10-29 15:55:15,121 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130cd3ea5ec04524dc1af44bdfc50d54be2 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130cd3ea5ec04524dc1af44bdfc50d54be2 2023-10-29 15:55:15,122 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:55:15,142 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/53063ba8b2bf4ff38f81886b8fc31765 first=Optional[r00] last=Optional[r8] 2023-10-29 15:55:15,143 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/53063ba8b2bf4ff38f81886b8fc31765}] 2023-10-29 15:55:15,145 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/53063ba8b2bf4ff38f81886b8fc31765 for inclusion in b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 2023-10-29 15:55:15,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-10-29 15:55:15,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last= 2023-10-29 15:55:15,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:15,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/53063ba8b2bf4ff38f81886b8fc31765 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m7tftpfdia0pfrc0nemialgmuoqmtm9tj3vbjc7975r75hh9ebtj6bj9t2pb8152/family1/53063ba8b2bf4ff38f81886b8fc31765 2023-10-29 15:55:15,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m7tftpfdia0pfrc0nemialgmuoqmtm9tj3vbjc7975r75hh9ebtj6bj9t2pb8152/family1/53063ba8b2bf4ff38f81886b8fc31765 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/6ecc74634f3a40feb2b008c01fc911dc_SeqId_49_ 2023-10-29 15:55:15,150 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m7tftpfdia0pfrc0nemialgmuoqmtm9tj3vbjc7975r75hh9ebtj6bj9t2pb8152/family1/53063ba8b2bf4ff38f81886b8fc31765 into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/6ecc74634f3a40feb2b008c01fc911dc_SeqId_49_ - updating store file list. 2023-10-29 15:55:15,152 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/6ecc74634f3a40feb2b008c01fc911dc_SeqId_49_ into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 2023-10-29 15:55:15,152 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m7tftpfdia0pfrc0nemialgmuoqmtm9tj3vbjc7975r75hh9ebtj6bj9t2pb8152/family1/53063ba8b2bf4ff38f81886b8fc31765 into b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/6ecc74634f3a40feb2b008c01fc911dc_SeqId_49_) 2023-10-29 15:55:15,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMinorCompactionWithMonthlyPolicy__m7tftpfdia0pfrc0nemialgmuoqmtm9tj3vbjc7975r75hh9ebtj6bj9t2pb8152/family1/53063ba8b2bf4ff38f81886b8fc31765 2023-10-29 15:55:15,154 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:55:15,155 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:15,156 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120233ddd7a45f041bdbf816e0e0f6a3533 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120233ddd7a45f041bdbf816e0e0f6a3533 2023-10-29 15:55:15,157 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511284b67576ac503449697cd1b7cd28f2eb7 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511284b67576ac503449697cd1b7cd28f2eb7 2023-10-29 15:55:15,157 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306a2f291d46ba4808b82ec2899069ec73 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201511306a2f291d46ba4808b82ec2899069ec73 2023-10-29 15:55:15,157 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-10-29 15:55:15,157 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-10-29 15:55:15,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:55:15,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:55:15,158 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-10-29 15:55:15,158 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-10-29 15:55:15,158 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:55:15,160 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-10-29 15:55:15,161 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.4530 sec 2023-10-29 15:55:15,335 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=265 (was 258) - Thread LEAK? -, OpenFileDescriptor=654 (was 647) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=180 (was 231), ProcessCount=167 (was 167), AvailableMemoryMB=3611 (was 2607) - AvailableMemoryMB LEAK? - 2023-10-29 15:55:15,346 INFO [Listener at localhost/37167] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=265, OpenFileDescriptor=654, MaxFileDescriptor=60000, SystemLoadAverage=180, ProcessCount=167, AvailableMemoryMB=3610 2023-10-29 15:55:15,367 DEBUG [Listener at localhost/37167] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-10-29 15:55:15,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x06@\xDAQ\x0C\xD5\x99\xF5<\xC36\xDB5\x7F\xC6E"\x10I\x94\x1E\xFB\x023\x96\xEAY\xCD\xC6V\xB3\x17s\xF1*\x10\x02\x0D\xBDXH\xED\x89\xA5?\xEC\xD9\x8B+\xC2\xE3\xD22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-10-29 15:55:15,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure2.ProcedureExecutor(1028): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-10-29 15:55:15,411 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-10-29 15:55:15,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-10-29 15:55:15,412 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-10-29 15:55:15,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8 empty. 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3 empty. 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81 empty. 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:15,414 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:15,414 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-10-29 15:55:15,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 15:55:15,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 15:55:15,821 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-10-29 15:55:15,823 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f0d91f6b52f81d934ece388d571edf8, NAME => 'testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x06@\xDAQ\x0C\xD5\x99\xF5<\xC36\xDB5\x7F\xC6E"\x10I\x94\x1E\xFB\x023\x96\xEAY\xCD\xC6V\xB3\x17s\xF1*\x10\x02\x0D\xBDXH\xED\x89\xA5?\xEC\xD9\x8B+\xC2\xE3\xD22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:55:15,823 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => 74004985fc8002d22a815fe47184cc81, NAME => 'testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x06@\xDAQ\x0C\xD5\x99\xF5<\xC36\xDB5\x7F\xC6E"\x10I\x94\x1E\xFB\x023\x96\xEAY\xCD\xC6V\xB3\x17s\xF1*\x10\x02\x0D\xBDXH\xED\x89\xA5?\xEC\xD9\x8B+\xC2\xE3\xD22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:55:15,823 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 154cfdee2a61aa0cbcf5a2ffc71b68c3, NAME => 'testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x06@\xDAQ\x0C\xD5\x99\xF5<\xC36\xDB5\x7F\xC6E"\x10I\x94\x1E\xFB\x023\x96\xEAY\xCD\xC6V\xB3\x17s\xF1*\x10\x02\x0D\xBDXH\xED\x89\xA5?\xEC\xD9\x8B+\xC2\xE3\xD22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/.tmp 2023-10-29 15:55:15,832 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:55:15,832 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 154cfdee2a61aa0cbcf5a2ffc71b68c3, disabling compactions & flushes 2023-10-29 15:55:15,832 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:15,832 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:15,832 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. after waiting 0 ms 2023-10-29 15:55:15,832 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:15,832 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:15,832 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:16,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 15:55:16,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:55:16,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing 74004985fc8002d22a815fe47184cc81, disabling compactions & flushes 2023-10-29 15:55:16,233 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:55:16,233 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:16,234 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 0f0d91f6b52f81d934ece388d571edf8, disabling compactions & flushes 2023-10-29 15:55:16,234 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:16,234 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:16,235 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:16,235 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. after waiting 0 ms 2023-10-29 15:55:16,235 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:16,235 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:16,235 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:16,234 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. after waiting 0 ms 2023-10-29 15:55:16,236 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:16,236 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:16,236 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:16,239 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-10-29 15:55:16,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698594916241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594916241"}]},"ts":"1698594916241"} 2023-10-29 15:55:16,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594916241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594916241"}]},"ts":"1698594916241"} 2023-10-29 15:55:16,241 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594916241"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1698594916241"}]},"ts":"1698594916241"} 2023-10-29 15:55:16,243 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-10-29 15:55:16,244 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-10-29 15:55:16,244 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594916244"}]},"ts":"1698594916244"} 2023-10-29 15:55:16,245 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-10-29 15:55:16,321 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/.tmp/family1/f7372874882d424a8f78e9596887d01a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/f7372874882d424a8f78e9596887d01a 2023-10-29 15:55:16,325 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in b1d03b3a7ea1f70fe02ec0f522ed00bc/family1 of b1d03b3a7ea1f70fe02ec0f522ed00bc into f7372874882d424a8f78e9596887d01a(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:55:16,325 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:16,325 INFO [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1698594915081; duration=1sec 2023-10-29 15:55:16,326 DEBUG [RS:0;jenkins-hbase20:44603-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-10-29 15:55:16,361 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/8aeab85e441f4c658f49c98729fd5d33, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9f242043b6954c85bbc751c5cd4b6832, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/3b21f0c04a6f44a2b373822e91735074_SeqId_47_] to archive 2023-10-29 15:55:16,362 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:16,365 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/8aeab85e441f4c658f49c98729fd5d33 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/8aeab85e441f4c658f49c98729fd5d33 2023-10-29 15:55:16,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9f242043b6954c85bbc751c5cd4b6832 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/9f242043b6954c85bbc751c5cd4b6832 2023-10-29 15:55:16,368 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/3b21f0c04a6f44a2b373822e91735074_SeqId_47_ to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/family1/3b21f0c04a6f44a2b373822e91735074_SeqId_47_ 2023-10-29 15:55:16,399 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f0d91f6b52f81d934ece388d571edf8, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=154cfdee2a61aa0cbcf5a2ffc71b68c3, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=74004985fc8002d22a815fe47184cc81, ASSIGN}] 2023-10-29 15:55:16,402 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=74004985fc8002d22a815fe47184cc81, ASSIGN 2023-10-29 15:55:16,402 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=154cfdee2a61aa0cbcf5a2ffc71b68c3, ASSIGN 2023-10-29 15:55:16,402 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f0d91f6b52f81d934ece388d571edf8, ASSIGN 2023-10-29 15:55:16,403 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f0d91f6b52f81d934ece388d571edf8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:55:16,403 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=74004985fc8002d22a815fe47184cc81, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:55:16,403 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=154cfdee2a61aa0cbcf5a2ffc71b68c3, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,44603,1698594767651; forceNewPlan=false, retain=false 2023-10-29 15:55:16,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 15:55:16,557 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=74004985fc8002d22a815fe47184cc81, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:16,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=0f0d91f6b52f81d934ece388d571edf8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:16,558 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594916557"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594916557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594916557"}]},"ts":"1698594916557"} 2023-10-29 15:55:16,558 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594916557"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594916557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594916557"}]},"ts":"1698594916557"} 2023-10-29 15:55:16,557 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=154cfdee2a61aa0cbcf5a2ffc71b68c3, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:16,559 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698594916557"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1698594916557"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1698594916557"}]},"ts":"1698594916557"} 2023-10-29 15:55:16,561 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure 74004985fc8002d22a815fe47184cc81, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:55:16,563 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=121, ppid=117, state=RUNNABLE; OpenRegionProcedure 0f0d91f6b52f81d934ece388d571edf8, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:55:16,564 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=122, ppid=118, state=RUNNABLE; OpenRegionProcedure 154cfdee2a61aa0cbcf5a2ffc71b68c3, server=jenkins-hbase20.apache.org,44603,1698594767651}] 2023-10-29 15:55:16,714 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:16,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:16,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 74004985fc8002d22a815fe47184cc81, NAME => 'testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81.', STARTKEY => '2', ENDKEY => ''} 2023-10-29 15:55:16,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:16,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:55:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:16,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:16,745 INFO [StoreOpener-74004985fc8002d22a815fe47184cc81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:16,746 DEBUG [StoreOpener-74004985fc8002d22a815fe47184cc81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1 2023-10-29 15:55:16,746 DEBUG [StoreOpener-74004985fc8002d22a815fe47184cc81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1 2023-10-29 15:55:16,747 INFO [StoreOpener-74004985fc8002d22a815fe47184cc81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74004985fc8002d22a815fe47184cc81 columnFamilyName family1 2023-10-29 15:55:16,748 INFO [StoreOpener-74004985fc8002d22a815fe47184cc81-1] regionserver.HStore(310): Store=74004985fc8002d22a815fe47184cc81/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:55:16,748 INFO [StoreOpener-74004985fc8002d22a815fe47184cc81-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:16,749 DEBUG [StoreOpener-74004985fc8002d22a815fe47184cc81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2 2023-10-29 15:55:16,749 DEBUG [StoreOpener-74004985fc8002d22a815fe47184cc81-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2 2023-10-29 15:55:16,749 INFO [StoreOpener-74004985fc8002d22a815fe47184cc81-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 74004985fc8002d22a815fe47184cc81 columnFamilyName family2 2023-10-29 15:55:16,750 INFO [StoreOpener-74004985fc8002d22a815fe47184cc81-1] regionserver.HStore(310): Store=74004985fc8002d22a815fe47184cc81/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:55:16,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:16,751 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:16,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:55:16,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:16,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:55:16,754 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 74004985fc8002d22a815fe47184cc81; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74264406, jitterRate=0.10662588477134705}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:55:16,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:16,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81., pid=120, masterSystemTime=1698594916714 2023-10-29 15:55:16,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:16,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:16,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:16,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 154cfdee2a61aa0cbcf5a2ffc71b68c3, NAME => 'testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3.', STARTKEY => '1', ENDKEY => '2'} 2023-10-29 15:55:16,756 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=74004985fc8002d22a815fe47184cc81, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:16,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:16,756 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594916756"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594916756"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594916756"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594916756"}]},"ts":"1698594916756"} 2023-10-29 15:55:16,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:55:16,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:16,757 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:16,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=120, resume processing ppid=119 2023-10-29 15:55:16,758 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure 74004985fc8002d22a815fe47184cc81, server=jenkins-hbase20.apache.org,44603,1698594767651 in 196 msec 2023-10-29 15:55:16,759 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=74004985fc8002d22a815fe47184cc81, ASSIGN in 359 msec 2023-10-29 15:55:16,775 INFO [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:16,777 DEBUG [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 2023-10-29 15:55:16,777 DEBUG [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 2023-10-29 15:55:16,777 INFO [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 154cfdee2a61aa0cbcf5a2ffc71b68c3 columnFamilyName family1 2023-10-29 15:55:16,778 INFO [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] regionserver.HStore(310): Store=154cfdee2a61aa0cbcf5a2ffc71b68c3/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:55:16,778 INFO [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:16,779 DEBUG [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2 2023-10-29 15:55:16,779 DEBUG [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2 2023-10-29 15:55:16,779 INFO [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 154cfdee2a61aa0cbcf5a2ffc71b68c3 columnFamilyName family2 2023-10-29 15:55:16,780 INFO [StoreOpener-154cfdee2a61aa0cbcf5a2ffc71b68c3-1] regionserver.HStore(310): Store=154cfdee2a61aa0cbcf5a2ffc71b68c3/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:55:16,780 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:16,781 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:16,782 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:55:16,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:16,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:55:16,784 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 154cfdee2a61aa0cbcf5a2ffc71b68c3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71376606, jitterRate=0.06359431147575378}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:55:16,784 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:16,785 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3., pid=122, masterSystemTime=1698594916714 2023-10-29 15:55:16,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:16,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:16,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:16,786 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=154cfdee2a61aa0cbcf5a2ffc71b68c3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:16,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f0d91f6b52f81d934ece388d571edf8, NAME => 'testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8.', STARTKEY => '', ENDKEY => '1'} 2023-10-29 15:55:16,786 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1698594916786"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594916786"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594916786"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594916786"}]},"ts":"1698594916786"} 2023-10-29 15:55:16,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:16,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-10-29 15:55:16,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:16,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:16,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=122, resume processing ppid=118 2023-10-29 15:55:16,789 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=122, ppid=118, state=SUCCESS; OpenRegionProcedure 154cfdee2a61aa0cbcf5a2ffc71b68c3, server=jenkins-hbase20.apache.org,44603,1698594767651 in 224 msec 2023-10-29 15:55:16,790 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=154cfdee2a61aa0cbcf5a2ffc71b68c3, ASSIGN in 390 msec 2023-10-29 15:55:16,805 INFO [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:16,807 DEBUG [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1 2023-10-29 15:55:16,807 DEBUG [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1 2023-10-29 15:55:16,807 INFO [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f0d91f6b52f81d934ece388d571edf8 columnFamilyName family1 2023-10-29 15:55:16,808 INFO [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] regionserver.HStore(310): Store=0f0d91f6b52f81d934ece388d571edf8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:55:16,808 INFO [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:16,809 DEBUG [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2 2023-10-29 15:55:16,809 DEBUG [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2 2023-10-29 15:55:16,809 INFO [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f0d91f6b52f81d934ece388d571edf8 columnFamilyName family2 2023-10-29 15:55:16,810 INFO [StoreOpener-0f0d91f6b52f81d934ece388d571edf8-1] regionserver.HStore(310): Store=0f0d91f6b52f81d934ece388d571edf8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-10-29 15:55:16,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:16,810 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:16,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-10-29 15:55:16,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:16,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-10-29 15:55:16,813 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 0f0d91f6b52f81d934ece388d571edf8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68754695, jitterRate=0.024524793028831482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-10-29 15:55:16,813 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:16,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8., pid=121, masterSystemTime=1698594916714 2023-10-29 15:55:16,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:16,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:16,815 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=0f0d91f6b52f81d934ece388d571edf8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:16,815 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1698594916815"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1698594916815"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1698594916815"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1698594916815"}]},"ts":"1698594916815"} 2023-10-29 15:55:16,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=121, resume processing ppid=117 2023-10-29 15:55:16,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=121, ppid=117, state=SUCCESS; OpenRegionProcedure 0f0d91f6b52f81d934ece388d571edf8, server=jenkins-hbase20.apache.org,44603,1698594767651 in 253 msec 2023-10-29 15:55:16,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=116 2023-10-29 15:55:16,818 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=0f0d91f6b52f81d934ece388d571edf8, ASSIGN in 418 msec 2023-10-29 15:55:16,818 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-10-29 15:55:16,818 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1698594916818"}]},"ts":"1698594916818"} 2023-10-29 15:55:16,819 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-10-29 15:55:16,821 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-10-29 15:55:16,822 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.4120 sec 2023-10-29 15:55:17,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-10-29 15:55:17,523 INFO [Listener at localhost/37167] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-10-29 15:55:17,535 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:17,536 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:17,536 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:17,539 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:17,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 15:55:17,542 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 15:55:17,542 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:17,542 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 15:55:17,542 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 15:55:17,542 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:17,543 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:17,544 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:17,544 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:17,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:17,544 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:17,544 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:17,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:17,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:17,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:17,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:17,546 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 15:55:17,546 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 15:55:17,546 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 15:55:17,546 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:17,546 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 15:55:17,546 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:17,547 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. started... 2023-10-29 15:55:17,547 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:17,547 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. started... 2023-10-29 15:55:17,547 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:55:17,548 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:17,548 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. started... 2023-10-29 15:55:17,548 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 154cfdee2a61aa0cbcf5a2ffc71b68c3 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:55:17,548 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:17,548 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 74004985fc8002d22a815fe47184cc81 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:55:17,549 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f0d91f6b52f81d934ece388d571edf8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-10-29 15:55:17,998 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102954c64a5c6bd74e5d9af7db381ffb7eae to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102954c64a5c6bd74e5d9af7db381ffb7eae 2023-10-29 15:55:17,998 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310296dbd6d68500148bfb16fa398e4edbcf6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310296dbd6d68500148bfb16fa398e4edbcf6 2023-10-29 15:55:17,998 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310297bb2185b365149fe80084e5ec780bae0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297bb2185b365149fe80084e5ec780bae0 2023-10-29 15:55:18,416 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/88619bceecc348ebb7bb3555c2446b67 2023-10-29 15:55:18,417 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/576f9ca49e30416682ffdb4762a177f3 2023-10-29 15:55:18,417 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/5145d05237d14b7fba3a857c1679fdd9 2023-10-29 15:55:18,864 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029bdc2dc3c61774e8aa4fddd07e4f0cd55 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029bdc2dc3c61774e8aa4fddd07e4f0cd55 2023-10-29 15:55:18,864 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310297c25ca2f71014f248c7f08673349d235 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310297c25ca2f71014f248c7f08673349d235 2023-10-29 15:55:18,869 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310296888a22cd8fd46b5a4c1f328b9df597f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310296888a22cd8fd46b5a4c1f328b9df597f 2023-10-29 15:55:18,869 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/4c7450a5069e4d7fbcb334d28f68018b 2023-10-29 15:55:18,870 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/573ee007243943c7b08a04c2d8fa4f13 2023-10-29 15:55:18,875 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/576f9ca49e30416682ffdb4762a177f3 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/576f9ca49e30416682ffdb4762a177f3 2023-10-29 15:55:18,875 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/5145d05237d14b7fba3a857c1679fdd9 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/5145d05237d14b7fba3a857c1679fdd9 2023-10-29 15:55:18,896 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/5145d05237d14b7fba3a857c1679fdd9, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 15:55:18,896 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/576f9ca49e30416682ffdb4762a177f3, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 15:55:18,897 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/573ee007243943c7b08a04c2d8fa4f13 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/573ee007243943c7b08a04c2d8fa4f13 2023-10-29 15:55:18,897 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/4c7450a5069e4d7fbcb334d28f68018b as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/4c7450a5069e4d7fbcb334d28f68018b 2023-10-29 15:55:18,900 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/573ee007243943c7b08a04c2d8fa4f13, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:55:18,900 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/4c7450a5069e4d7fbcb334d28f68018b, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:55:18,901 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0f0d91f6b52f81d934ece388d571edf8 in 1352ms, sequenceid=5, compaction requested=false 2023-10-29 15:55:18,901 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 74004985fc8002d22a815fe47184cc81 in 1353ms, sequenceid=5, compaction requested=false 2023-10-29 15:55:18,901 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-10-29 15:55:18,901 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-10-29 15:55:18,902 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:18,902 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:18,903 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:18,903 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:18,903 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:55:18,903 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:55:19,276 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/d895dca3ad684488ad9f09ed08dd5e30 2023-10-29 15:55:19,289 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/88619bceecc348ebb7bb3555c2446b67 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/88619bceecc348ebb7bb3555c2446b67 2023-10-29 15:55:19,315 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/88619bceecc348ebb7bb3555c2446b67, entries=4, sequenceid=5, filesize=5.5 K 2023-10-29 15:55:19,316 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/d895dca3ad684488ad9f09ed08dd5e30 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/d895dca3ad684488ad9f09ed08dd5e30 2023-10-29 15:55:19,319 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/d895dca3ad684488ad9f09ed08dd5e30, entries=2, sequenceid=5, filesize=5.1 K 2023-10-29 15:55:19,320 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 154cfdee2a61aa0cbcf5a2ffc71b68c3 in 1772ms, sequenceid=5, compaction requested=false 2023-10-29 15:55:19,320 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:19,320 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:19,320 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:55:19,320 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:55:19,320 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,320 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 15:55:19,320 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 15:55:19,321 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,321 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:19,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:19,321 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:19,321 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:19,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:19,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:19,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:19,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:19,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 15:55:19,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50388bd0[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:19,323 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 15:55:19,323 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:19,323 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:19,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:19,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:19,323 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 15:55:19,323 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 15:55:19,323 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:19,323 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,323 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:19,324 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 15:55:19,324 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,324 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:19,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:19,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:19,324 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 15:55:19,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:19,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:19,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:19,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:19,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:19,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:19,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 15:55:19,326 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 15:55:19,326 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:19,326 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:19,326 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 15:55:19,326 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:19,327 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,327 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:19,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:19,327 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:19,327 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:19,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:19,328 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:19,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,329 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:19,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:19,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:19,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:19,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 15:55:19,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:19,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:19,330 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:19,330 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:19,330 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:19,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:19,430 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:19,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:19,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:19,435 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:19,436 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:19,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:19,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:19,445 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 15:55:19,445 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 15:55:19,445 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:19,445 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 15:55:19,445 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 15:55:19,446 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,446 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:19,447 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:19,447 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:19,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:19,447 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,447 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:19,448 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:19,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:19,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:19,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:19,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:19,449 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 15:55:19,449 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 15:55:19,449 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 15:55:19,449 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 15:55:19,449 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:19,449 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 15:55:19,449 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:19,449 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. started... 2023-10-29 15:55:19,449 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:55:19,449 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:19,450 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:19,450 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. started... 2023-10-29 15:55:19,449 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:19,450 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f0d91f6b52f81d934ece388d571edf8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:55:19,450 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. started... 2023-10-29 15:55:19,450 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 74004985fc8002d22a815fe47184cc81 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:55:19,450 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 154cfdee2a61aa0cbcf5a2ffc71b68c3 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-10-29 15:55:19,891 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102901116f99dec74ba9b0df9d8690159ff6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102901116f99dec74ba9b0df9d8690159ff6 2023-10-29 15:55:19,891 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029333d2d5dda6f4c20a86c6415146c625e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029333d2d5dda6f4c20a86c6415146c625e 2023-10-29 15:55:19,892 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310297ada7ad5eb8645dc8d8fab846b468f78 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297ada7ad5eb8645dc8d8fab846b468f78 2023-10-29 15:55:20,305 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/25db38f87b7c42a0b56138eaf047e1bc 2023-10-29 15:55:20,310 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/cb7e58b0f2794bc38d318b2f3042ca15 2023-10-29 15:55:20,310 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/bc062a01b9ed4b5b952ae7362ea079d5 2023-10-29 15:55:20,344 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023102901e05aadc0b44efb9a134fc4181d454a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023102901e05aadc0b44efb9a134fc4181d454a 2023-10-29 15:55:20,344 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023102984c56db2ca7047bd823e2fb3cbc9fd94 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023102984c56db2ca7047bd823e2fb3cbc9fd94 2023-10-29 15:55:20,747 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029c5834a206523416a9813d8627c16c63f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231029c5834a206523416a9813d8627c16c63f 2023-10-29 15:55:20,748 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/c55a0d89fa994cd5ae60bc99ff040808 2023-10-29 15:55:20,750 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/92ae8ade2ba14630848de834620916e9 2023-10-29 15:55:20,753 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/bc062a01b9ed4b5b952ae7362ea079d5 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/bc062a01b9ed4b5b952ae7362ea079d5 2023-10-29 15:55:20,754 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/25db38f87b7c42a0b56138eaf047e1bc as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/25db38f87b7c42a0b56138eaf047e1bc 2023-10-29 15:55:20,775 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/25db38f87b7c42a0b56138eaf047e1bc, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 15:55:20,776 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/92ae8ade2ba14630848de834620916e9 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/92ae8ade2ba14630848de834620916e9 2023-10-29 15:55:20,776 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/bc062a01b9ed4b5b952ae7362ea079d5, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 15:55:20,777 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/c55a0d89fa994cd5ae60bc99ff040808 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/c55a0d89fa994cd5ae60bc99ff040808 2023-10-29 15:55:20,779 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/92ae8ade2ba14630848de834620916e9, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:55:20,780 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/c55a0d89fa994cd5ae60bc99ff040808, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:55:20,780 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0f0d91f6b52f81d934ece388d571edf8 in 1330ms, sequenceid=9, compaction requested=false 2023-10-29 15:55:20,780 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:20,780 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:20,780 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:55:20,780 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 154cfdee2a61aa0cbcf5a2ffc71b68c3 in 1330ms, sequenceid=9, compaction requested=false 2023-10-29 15:55:20,780 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:20,780 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:20,780 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:55:21,155 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/5ad338b4222e44b0bcf48e5f46d63093 2023-10-29 15:55:21,160 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/cb7e58b0f2794bc38d318b2f3042ca15 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/cb7e58b0f2794bc38d318b2f3042ca15 2023-10-29 15:55:21,182 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/cb7e58b0f2794bc38d318b2f3042ca15, entries=4, sequenceid=9, filesize=5.5 K 2023-10-29 15:55:21,183 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/5ad338b4222e44b0bcf48e5f46d63093 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5ad338b4222e44b0bcf48e5f46d63093 2023-10-29 15:55:21,188 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5ad338b4222e44b0bcf48e5f46d63093, entries=2, sequenceid=9, filesize=5.1 K 2023-10-29 15:55:21,189 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 74004985fc8002d22a815fe47184cc81 in 1740ms, sequenceid=9, compaction requested=false 2023-10-29 15:55:21,189 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:21,189 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:21,189 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:55:21,189 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:55:21,189 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,189 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 15:55:21,189 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 15:55:21,190 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,190 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:21,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:21,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:21,191 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:21,191 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:21,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 15:55:21,192 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29084605[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:21,192 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 15:55:21,192 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:21,192 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:21,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:21,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:21,192 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 15:55:21,192 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 15:55:21,192 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:21,192 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,192 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:21,193 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 15:55:21,193 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,193 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:21,193 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 15:55:21,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:21,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:21,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:21,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:21,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:21,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:21,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:21,195 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 15:55:21,195 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 15:55:21,195 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:21,195 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:21,195 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 15:55:21,195 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:21,196 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,196 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,196 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:21,196 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,196 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:21,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:21,197 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:21,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:21,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:21,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,198 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,198 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:21,198 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:21,198 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:21,198 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:21,198 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 15:55:21,199 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:21,198 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:21,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:21,198 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:21,199 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 15:55:21,198 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,199 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:21,199 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:21,199 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:21,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:21,199 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,199 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:21,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:21,299 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:21,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:21,301 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:21,301 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:21,301 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:21,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:21,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:21,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 15:55:21,305 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 15:55:21,305 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:21,305 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 15:55:21,305 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 15:55:21,305 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,305 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:21,306 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:21,306 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:21,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:21,307 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:21,307 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:21,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:21,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:21,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:21,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:21,308 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 15:55:21,308 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 15:55:21,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 15:55:21,308 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 15:55:21,308 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:21,308 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 15:55:21,308 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:21,308 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. started... 2023-10-29 15:55:21,309 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:55:21,309 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:21,309 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 74004985fc8002d22a815fe47184cc81 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:55:21,309 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:21,309 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. started... 2023-10-29 15:55:21,309 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:21,309 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. started... 2023-10-29 15:55:21,309 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 154cfdee2a61aa0cbcf5a2ffc71b68c3 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:55:21,309 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f0d91f6b52f81d934ece388d571edf8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-10-29 15:55:21,350 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029871922f966e045298c98ccb7e861c5c7 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029871922f966e045298c98ccb7e861c5c7 2023-10-29 15:55:21,753 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029aa276eee7b2a4b18a71dae064145802c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029aa276eee7b2a4b18a71dae064145802c 2023-10-29 15:55:21,753 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029f82a28446a1149afba7c4542930b2f85 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f82a28446a1149afba7c4542930b2f85 2023-10-29 15:55:21,762 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/629881d89503481cbd681d2a70b3ac05 2023-10-29 15:55:21,783 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/0182018b7d514be2bca7616aae013b6e 2023-10-29 15:55:22,177 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/73c5024a62684738b8db910757411b71 2023-10-29 15:55:22,207 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310293f29b488c2c7411e8742383de3ebeed6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202310293f29b488c2c7411e8742383de3ebeed6 2023-10-29 15:55:22,212 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310299c94d7c5cead4c92990cc57d5e33a01e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310299c94d7c5cead4c92990cc57d5e33a01e 2023-10-29 15:55:22,215 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029ee181aa691e44843ae2cd9160b17268d to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029ee181aa691e44843ae2cd9160b17268d 2023-10-29 15:55:22,273 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-10-29 15:55:22,612 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/5e32928dd2c34005a46067d3ec78f57c 2023-10-29 15:55:22,623 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/629881d89503481cbd681d2a70b3ac05 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/629881d89503481cbd681d2a70b3ac05 2023-10-29 15:55:22,624 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/e195ccc7e4cf465eb1a5b8c5cc481c3a 2023-10-29 15:55:22,624 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/7ee24ac4b5d54a3a89d61566432eb330 2023-10-29 15:55:22,630 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/0182018b7d514be2bca7616aae013b6e as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0182018b7d514be2bca7616aae013b6e 2023-10-29 15:55:22,631 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/73c5024a62684738b8db910757411b71 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/73c5024a62684738b8db910757411b71 2023-10-29 15:55:22,652 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/73c5024a62684738b8db910757411b71, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 15:55:22,653 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/7ee24ac4b5d54a3a89d61566432eb330 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/7ee24ac4b5d54a3a89d61566432eb330 2023-10-29 15:55:22,653 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/629881d89503481cbd681d2a70b3ac05, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 15:55:22,654 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/5e32928dd2c34005a46067d3ec78f57c as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5e32928dd2c34005a46067d3ec78f57c 2023-10-29 15:55:22,657 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0182018b7d514be2bca7616aae013b6e, entries=4, sequenceid=13, filesize=5.5 K 2023-10-29 15:55:22,658 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/e195ccc7e4cf465eb1a5b8c5cc481c3a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e195ccc7e4cf465eb1a5b8c5cc481c3a 2023-10-29 15:55:22,660 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/7ee24ac4b5d54a3a89d61566432eb330, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:55:22,660 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5e32928dd2c34005a46067d3ec78f57c, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:55:22,661 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 74004985fc8002d22a815fe47184cc81 in 1351ms, sequenceid=13, compaction requested=true 2023-10-29 15:55:22,661 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0f0d91f6b52f81d934ece388d571edf8 in 1351ms, sequenceid=13, compaction requested=true 2023-10-29 15:55:22,661 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:22,661 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:22,661 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:22,661 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:22,661 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:55:22,661 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:55:22,662 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e195ccc7e4cf465eb1a5b8c5cc481c3a, entries=2, sequenceid=13, filesize=5.1 K 2023-10-29 15:55:22,663 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 154cfdee2a61aa0cbcf5a2ffc71b68c3 in 1354ms, sequenceid=13, compaction requested=true 2023-10-29 15:55:22,663 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:22,663 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:22,663 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:55:22,663 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:55:22,663 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,663 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 15:55:22,663 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 15:55:22,664 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:22,664 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:22,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:22,664 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:22,664 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:22,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:22,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:22,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:22,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:22,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 15:55:22,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6770d430[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:22,665 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 15:55:22,665 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:22,666 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:22,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:22,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:22,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 15:55:22,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 15:55:22,666 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,666 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:22,666 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:22,667 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,667 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 15:55:22,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,667 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:22,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:22,667 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 15:55:22,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:22,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:22,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:22,669 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 15:55:22,669 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 15:55:22,669 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:22,669 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:22,669 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 15:55:22,669 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:22,670 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,670 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,670 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:22,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,671 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:22,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:22,671 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,672 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:22,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:22,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:22,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:22,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 15:55:22,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:22,674 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:22,674 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:22,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:22,674 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:22,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:22,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:22,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 15:55:22,774 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:22,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:22,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:22,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:22,777 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. with WAL disabled. Data may be lost in the event of a crash. 2023-10-29 15:55:22,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:22,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:22,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 15:55:22,782 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 15:55:22,782 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:22,782 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 15:55:22,782 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 15:55:22,783 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,783 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:22,784 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:22,784 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,784 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:22,785 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:22,785 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:22,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:22,786 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:22,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:22,786 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 15:55:22,787 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 15:55:22,787 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 15:55:22,787 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 15:55:22,787 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:22,787 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 15:55:22,787 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:22,787 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. started... 2023-10-29 15:55:22,787 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:22,787 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:55:22,788 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:22,788 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:22,788 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. started... 2023-10-29 15:55:22,788 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 74004985fc8002d22a815fe47184cc81 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:55:22,788 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f0d91f6b52f81d934ece388d571edf8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:55:22,787 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. started... 2023-10-29 15:55:22,788 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 154cfdee2a61aa0cbcf5a2ffc71b68c3 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-10-29 15:55:22,830 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310292a9bb8ad3340462f81c1981b1bd773cd to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310292a9bb8ad3340462f81c1981b1bd773cd 2023-10-29 15:55:22,830 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029e6c4a46348344032b672410a1ab0eaad to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029e6c4a46348344032b672410a1ab0eaad 2023-10-29 15:55:23,242 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310299786b72d86d1414ea34070095ac91fe9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310299786b72d86d1414ea34070095ac91fe9 2023-10-29 15:55:23,243 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/82da699ad8c24d4fb1dd4cc798fda58f 2023-10-29 15:55:23,244 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/b0a59a102f1e4d0d86451a3037ef62f8 2023-10-29 15:55:23,270 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029ba8d5c6e08824eef8335ec04b47b1200 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029ba8d5c6e08824eef8335ec04b47b1200 2023-10-29 15:55:23,657 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/47ba7c05dcf54b5facdb05e4ec8b1a92 2023-10-29 15:55:23,673 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310299a83fb66c4a5464996af8ad7a8d11251 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202310299a83fb66c4a5464996af8ad7a8d11251 2023-10-29 15:55:23,675 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/85d4fa1fa7614e7d86bbad06fd1c1b4a 2023-10-29 15:55:23,678 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/e3b3cc7beaa949eea77ac2f64224eb8e 2023-10-29 15:55:23,679 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/82da699ad8c24d4fb1dd4cc798fda58f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/82da699ad8c24d4fb1dd4cc798fda58f 2023-10-29 15:55:23,681 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/b0a59a102f1e4d0d86451a3037ef62f8 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/b0a59a102f1e4d0d86451a3037ef62f8 2023-10-29 15:55:23,699 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/82da699ad8c24d4fb1dd4cc798fda58f, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 15:55:23,700 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/85d4fa1fa7614e7d86bbad06fd1c1b4a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/85d4fa1fa7614e7d86bbad06fd1c1b4a 2023-10-29 15:55:23,701 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/b0a59a102f1e4d0d86451a3037ef62f8, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 15:55:23,702 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/e3b3cc7beaa949eea77ac2f64224eb8e as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e3b3cc7beaa949eea77ac2f64224eb8e 2023-10-29 15:55:23,703 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/85d4fa1fa7614e7d86bbad06fd1c1b4a, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:55:23,704 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0f0d91f6b52f81d934ece388d571edf8 in 916ms, sequenceid=17, compaction requested=true 2023-10-29 15:55:23,704 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:23,704 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:23,704 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:55:23,705 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e3b3cc7beaa949eea77ac2f64224eb8e, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:55:23,705 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 154cfdee2a61aa0cbcf5a2ffc71b68c3 in 917ms, sequenceid=17, compaction requested=true 2023-10-29 15:55:23,705 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:23,705 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:23,706 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:55:24,103 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023102944f20301528a402cba0f2174e068bd16 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023102944f20301528a402cba0f2174e068bd16 2023-10-29 15:55:24,510 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/4e1dccf3c4cd4fc09c562d2a9474446a 2023-10-29 15:55:24,514 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/47ba7c05dcf54b5facdb05e4ec8b1a92 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/47ba7c05dcf54b5facdb05e4ec8b1a92 2023-10-29 15:55:24,534 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/47ba7c05dcf54b5facdb05e4ec8b1a92, entries=4, sequenceid=17, filesize=5.5 K 2023-10-29 15:55:24,535 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/4e1dccf3c4cd4fc09c562d2a9474446a as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/4e1dccf3c4cd4fc09c562d2a9474446a 2023-10-29 15:55:24,540 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/4e1dccf3c4cd4fc09c562d2a9474446a, entries=2, sequenceid=17, filesize=5.1 K 2023-10-29 15:55:24,540 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 74004985fc8002d22a815fe47184cc81 in 1753ms, sequenceid=17, compaction requested=true 2023-10-29 15:55:24,541 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:24,541 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:55:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:55:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 15:55:24,541 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 15:55:24,542 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:24,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:24,542 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:24,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:24,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 15:55:24,543 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1290215f[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:24,543 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 15:55:24,544 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:24,544 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:24,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:24,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:24,544 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 15:55:24,544 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 15:55:24,544 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:24,544 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,544 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:24,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 15:55:24,545 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:24,545 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 15:55:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:24,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:24,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:24,547 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 15:55:24,547 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 15:55:24,547 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:24,547 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:24,547 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 15:55:24,547 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:24,547 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,547 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:24,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,548 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:24,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:24,548 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:24,548 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,549 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:24,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:24,550 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:24,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 15:55:24,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:24,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:24,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:24,550 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:24,651 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:24,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:24,663 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:24,670 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:24,678 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:24,679 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:24,764 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(936): Client=jenkins//148.251.75.209 procedure request for: flush-table-proc 2023-10-29 15:55:24,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-10-29 15:55:24,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-10-29 15:55:24,765 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-10-29 15:55:24,765 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:24,765 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-10-29 15:55:24,765 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-10-29 15:55:24,766 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,766 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:24,766 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:24,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:24,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:24,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-10-29 15:55:24,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:24,768 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-10-29 15:55:24,767 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,772 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-10-29 15:55:24,772 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-10-29 15:55:24,772 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-10-29 15:55:24,772 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-10-29 15:55:24,772 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:24,772 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-10-29 15:55:24,772 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-10-29 15:55:24,774 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:24,774 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. started... 2023-10-29 15:55:24,774 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 74004985fc8002d22a815fe47184cc81 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:55:24,775 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:24,775 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. started... 2023-10-29 15:55:24,775 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-10-29 15:55:24,775 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-10-29 15:55:24,775 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 154cfdee2a61aa0cbcf5a2ffc71b68c3 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:55:24,775 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:24,775 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. started... 2023-10-29 15:55:24,775 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 0f0d91f6b52f81d934ece388d571edf8 2/2 column families, dataSize=138 B heapSize=944 B 2023-10-29 15:55:25,217 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/963ad03ad3ba4b5384bfb8360e940009 2023-10-29 15:55:25,220 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/fc1b433f57d549f987fbfb0916e2b536 2023-10-29 15:55:25,244 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 963ad03ad3ba4b5384bfb8360e940009 2023-10-29 15:55:25,248 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc1b433f57d549f987fbfb0916e2b536 2023-10-29 15:55:25,635 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/5417ee9dc581414aac952d06305056d1 2023-10-29 15:55:25,654 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/56f92e77bf104f53aabc3349b59076eb 2023-10-29 15:55:25,658 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5417ee9dc581414aac952d06305056d1 2023-10-29 15:55:25,658 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56f92e77bf104f53aabc3349b59076eb 2023-10-29 15:55:25,659 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/631d969b88ae446aa638a1653ee29fb5 2023-10-29 15:55:25,660 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/963ad03ad3ba4b5384bfb8360e940009 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/963ad03ad3ba4b5384bfb8360e940009 2023-10-29 15:55:25,663 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 631d969b88ae446aa638a1653ee29fb5 2023-10-29 15:55:25,672 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/fc1b433f57d549f987fbfb0916e2b536 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/fc1b433f57d549f987fbfb0916e2b536 2023-10-29 15:55:25,693 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/63e8e90fc0db453d9428e6543270e091 2023-10-29 15:55:25,693 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 963ad03ad3ba4b5384bfb8360e940009 2023-10-29 15:55:25,693 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/963ad03ad3ba4b5384bfb8360e940009, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 15:55:25,694 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/56f92e77bf104f53aabc3349b59076eb as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/56f92e77bf104f53aabc3349b59076eb 2023-10-29 15:55:25,697 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63e8e90fc0db453d9428e6543270e091 2023-10-29 15:55:25,699 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/5417ee9dc581414aac952d06305056d1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/5417ee9dc581414aac952d06305056d1 2023-10-29 15:55:25,701 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 56f92e77bf104f53aabc3349b59076eb 2023-10-29 15:55:25,701 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/56f92e77bf104f53aabc3349b59076eb, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 15:55:25,702 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0f0d91f6b52f81d934ece388d571edf8 in 927ms, sequenceid=23, compaction requested=true 2023-10-29 15:55:25,702 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:25,702 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:25,702 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-10-29 15:55:25,702 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fc1b433f57d549f987fbfb0916e2b536 2023-10-29 15:55:25,702 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/fc1b433f57d549f987fbfb0916e2b536, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 15:55:25,703 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/631d969b88ae446aa638a1653ee29fb5 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/631d969b88ae446aa638a1653ee29fb5 2023-10-29 15:55:25,708 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 631d969b88ae446aa638a1653ee29fb5 2023-10-29 15:55:25,708 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/631d969b88ae446aa638a1653ee29fb5, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 15:55:25,709 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 74004985fc8002d22a815fe47184cc81 in 935ms, sequenceid=23, compaction requested=true 2023-10-29 15:55:25,709 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:25,709 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:25,709 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-10-29 15:55:25,730 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5417ee9dc581414aac952d06305056d1 2023-10-29 15:55:25,731 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/5417ee9dc581414aac952d06305056d1, entries=3, sequenceid=23, filesize=5.2 K 2023-10-29 15:55:25,731 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/63e8e90fc0db453d9428e6543270e091 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/63e8e90fc0db453d9428e6543270e091 2023-10-29 15:55:25,735 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63e8e90fc0db453d9428e6543270e091 2023-10-29 15:55:25,735 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/63e8e90fc0db453d9428e6543270e091, entries=1, sequenceid=23, filesize=5.0 K 2023-10-29 15:55:25,736 INFO [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 154cfdee2a61aa0cbcf5a2ffc71b68c3 in 961ms, sequenceid=23, compaction requested=true 2023-10-29 15:55:25,736 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:25,736 DEBUG [rs(jenkins-hbase20.apache.org,44603,1698594767651)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:25,736 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-10-29 15:55:25,736 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-10-29 15:55:25,736 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,736 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-10-29 15:55:25,736 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-10-29 15:55:25,737 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,737 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:25,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:25,738 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:25,738 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-10-29 15:55:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:25,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,44603,1698594767651' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-10-29 15:55:25,739 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6625ed6[Count = 0] remaining members to acquire global barrier 2023-10-29 15:55:25,739 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-10-29 15:55:25,739 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:25,739 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:25,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:25,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:25,739 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-10-29 15:55:25,740 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-10-29 15:55:25,740 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,740 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-10-29 15:55:25,740 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase20.apache.org,44603,1698594767651' in zk 2023-10-29 15:55:25,740 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-10-29 15:55:25,740 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,740 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:25,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:25,740 DEBUG [member: 'jenkins-hbase20.apache.org,44603,1698594767651' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-10-29 15:55:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:25,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase20.apache.org,44603,1698594767651': 2023-10-29 15:55:25,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,44603,1698594767651' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-10-29 15:55:25,742 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-10-29 15:55:25,742 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-10-29 15:55:25,742 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-10-29 15:55:25,742 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-10-29 15:55:25,742 INFO [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-10-29 15:55:25,743 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:25,743 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:25,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:25,743 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-10-29 15:55:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-10-29 15:55:25,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:25,743 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-10-29 15:55:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-10-29 15:55:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:25,744 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-10-29 15:55:25,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-10-29 15:55:25,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:25,746 DEBUG [(jenkins-hbase20.apache.org,46089,1698594766633)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-10-29 15:55:25,746 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-10-29 15:55:25,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-10-29 15:55:25,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-10-29 15:55:25,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-10-29 15:55:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-10-29 15:55:25,746 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-10-29 15:55:25,746 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-10-29 15:55:25,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-10-29 15:55:25,846 DEBUG [Listener at localhost/37167] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-10-29 15:55:25,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46089] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-10-29 15:55:25,848 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:25,848 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 74004985fc8002d22a815fe47184cc81/family1 is initiating major compaction (all files) 2023-10-29 15:55:25,848 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:25,848 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:25,850 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 74004985fc8002d22a815fe47184cc81/family1 in testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:25,850 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/5145d05237d14b7fba3a857c1679fdd9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/cb7e58b0f2794bc38d318b2f3042ca15, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/629881d89503481cbd681d2a70b3ac05, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/47ba7c05dcf54b5facdb05e4ec8b1a92, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/fc1b433f57d549f987fbfb0916e2b536] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp, totalSize=27.1 K 2023-10-29 15:55:25,851 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 5145d05237d14b7fba3a857c1679fdd9, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594917536 2023-10-29 15:55:25,852 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting cb7e58b0f2794bc38d318b2f3042ca15, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594919436 2023-10-29 15:55:25,852 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 629881d89503481cbd681d2a70b3ac05, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594921301 2023-10-29 15:55:25,852 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 47ba7c05dcf54b5facdb05e4ec8b1a92, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594922777 2023-10-29 15:55:25,853 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting fc1b433f57d549f987fbfb0916e2b536, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:25,867 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 74004985fc8002d22a815fe47184cc81#family1#compaction#196 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:25,905 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310293e82be45b1824438ae0f2a37c35e8c07_del 2023-10-29 15:55:25,906 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310293e82be45b1824438ae0f2a37c35e8c07_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310293e82be45b1824438ae0f2a37c35e8c07_del 2023-10-29 15:55:26,759 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7659adda8bf04c1fa505e36151422623 2023-10-29 15:55:26,760 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family1/7659adda8bf04c1fa505e36151422623 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/7659adda8bf04c1fa505e36151422623 2023-10-29 15:55:26,780 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7659adda8bf04c1fa505e36151422623 2023-10-29 15:55:26,781 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 74004985fc8002d22a815fe47184cc81/family1 of 74004985fc8002d22a815fe47184cc81 into 7659adda8bf04c1fa505e36151422623(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-10-29 15:55:26,781 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:26,781 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:26,781 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 74004985fc8002d22a815fe47184cc81/family2 is initiating major compaction (all files) 2023-10-29 15:55:26,781 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:26,781 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:26,781 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 74004985fc8002d22a815fe47184cc81/family2 in testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:26,781 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/573ee007243943c7b08a04c2d8fa4f13, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5ad338b4222e44b0bcf48e5f46d63093, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5e32928dd2c34005a46067d3ec78f57c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/4e1dccf3c4cd4fc09c562d2a9474446a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/631d969b88ae446aa638a1653ee29fb5] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp, totalSize=25.4 K 2023-10-29 15:55:26,782 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 573ee007243943c7b08a04c2d8fa4f13, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594917536 2023-10-29 15:55:26,782 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 5ad338b4222e44b0bcf48e5f46d63093, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594919436 2023-10-29 15:55:26,783 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 5e32928dd2c34005a46067d3ec78f57c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594921301 2023-10-29 15:55:26,783 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 4e1dccf3c4cd4fc09c562d2a9474446a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594922777 2023-10-29 15:55:26,784 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 631d969b88ae446aa638a1653ee29fb5, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:26,791 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 74004985fc8002d22a815fe47184cc81#family2#compaction#197 average throughput is 1.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:26,807 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:55:26,807 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1632c2f4 to 127.0.0.1:62629 2023-10-29 15:55:26,807 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:26,807 INFO [Finalizer] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:55:26,807 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b407dd4 to 127.0.0.1:62629 2023-10-29 15:55:26,807 DEBUG [Finalizer] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:26,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/5145d05237d14b7fba3a857c1679fdd9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/cb7e58b0f2794bc38d318b2f3042ca15, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/629881d89503481cbd681d2a70b3ac05, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/47ba7c05dcf54b5facdb05e4ec8b1a92, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/fc1b433f57d549f987fbfb0916e2b536] to archive 2023-10-29 15:55:26,861 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:26,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/5145d05237d14b7fba3a857c1679fdd9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/5145d05237d14b7fba3a857c1679fdd9 2023-10-29 15:55:26,864 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/cb7e58b0f2794bc38d318b2f3042ca15 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/cb7e58b0f2794bc38d318b2f3042ca15 2023-10-29 15:55:26,866 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/629881d89503481cbd681d2a70b3ac05 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/629881d89503481cbd681d2a70b3ac05 2023-10-29 15:55:26,867 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/47ba7c05dcf54b5facdb05e4ec8b1a92 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/47ba7c05dcf54b5facdb05e4ec8b1a92 2023-10-29 15:55:26,868 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/fc1b433f57d549f987fbfb0916e2b536 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/fc1b433f57d549f987fbfb0916e2b536 2023-10-29 15:55:27,213 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231029dbd5789714b840968aa101c10185216f_del 2023-10-29 15:55:27,213 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231029dbd5789714b840968aa101c10185216f_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231029dbd5789714b840968aa101c10185216f_del 2023-10-29 15:55:28,027 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cd16165a42c44f793b5b480a96da4de 2023-10-29 15:55:28,028 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/.tmp/family2/8cd16165a42c44f793b5b480a96da4de as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/8cd16165a42c44f793b5b480a96da4de 2023-10-29 15:55:28,031 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8cd16165a42c44f793b5b480a96da4de 2023-10-29 15:55:28,032 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 74004985fc8002d22a815fe47184cc81/family2 of 74004985fc8002d22a815fe47184cc81 into 8cd16165a42c44f793b5b480a96da4de(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:55:28,032 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:28,032 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:28,033 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 is initiating major compaction (all files) 2023-10-29 15:55:28,033 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:28,033 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:28,033 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 in testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:28,034 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/88619bceecc348ebb7bb3555c2446b67, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/bc062a01b9ed4b5b952ae7362ea079d5, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0182018b7d514be2bca7616aae013b6e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/b0a59a102f1e4d0d86451a3037ef62f8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/5417ee9dc581414aac952d06305056d1] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp, totalSize=27.1 K 2023-10-29 15:55:28,034 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 88619bceecc348ebb7bb3555c2446b67, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594917536 2023-10-29 15:55:28,034 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting bc062a01b9ed4b5b952ae7362ea079d5, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594919435 2023-10-29 15:55:28,035 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 0182018b7d514be2bca7616aae013b6e, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594921301 2023-10-29 15:55:28,035 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting b0a59a102f1e4d0d86451a3037ef62f8, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594922777 2023-10-29 15:55:28,036 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 5417ee9dc581414aac952d06305056d1, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:28,043 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 154cfdee2a61aa0cbcf5a2ffc71b68c3#family1#compaction#198 average throughput is 1.72 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:28,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/573ee007243943c7b08a04c2d8fa4f13, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5ad338b4222e44b0bcf48e5f46d63093, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5e32928dd2c34005a46067d3ec78f57c, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/4e1dccf3c4cd4fc09c562d2a9474446a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/631d969b88ae446aa638a1653ee29fb5] to archive 2023-10-29 15:55:28,061 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:28,063 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/573ee007243943c7b08a04c2d8fa4f13 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/573ee007243943c7b08a04c2d8fa4f13 2023-10-29 15:55:28,064 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5ad338b4222e44b0bcf48e5f46d63093 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5ad338b4222e44b0bcf48e5f46d63093 2023-10-29 15:55:28,065 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5e32928dd2c34005a46067d3ec78f57c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/5e32928dd2c34005a46067d3ec78f57c 2023-10-29 15:55:28,066 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/4e1dccf3c4cd4fc09c562d2a9474446a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/4e1dccf3c4cd4fc09c562d2a9474446a 2023-10-29 15:55:28,067 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/631d969b88ae446aa638a1653ee29fb5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family2/631d969b88ae446aa638a1653ee29fb5 2023-10-29 15:55:28,480 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310293898cfab2fb6426fa85ea868f5e67eee_del 2023-10-29 15:55:28,480 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310293898cfab2fb6426fa85ea868f5e67eee_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310293898cfab2fb6426fa85ea868f5e67eee_del 2023-10-29 15:55:29,342 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63e085caaae34ddab4dedb90d265b778 2023-10-29 15:55:29,343 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family1/63e085caaae34ddab4dedb90d265b778 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/63e085caaae34ddab4dedb90d265b778 2023-10-29 15:55:29,362 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 63e085caaae34ddab4dedb90d265b778 2023-10-29 15:55:29,363 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 of 154cfdee2a61aa0cbcf5a2ffc71b68c3 into 63e085caaae34ddab4dedb90d265b778(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:55:29,363 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:29,363 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:29,363 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 154cfdee2a61aa0cbcf5a2ffc71b68c3/family2 is initiating major compaction (all files) 2023-10-29 15:55:29,363 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:29,363 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:29,364 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 154cfdee2a61aa0cbcf5a2ffc71b68c3/family2 in testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:29,364 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/d895dca3ad684488ad9f09ed08dd5e30, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/c55a0d89fa994cd5ae60bc99ff040808, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e195ccc7e4cf465eb1a5b8c5cc481c3a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e3b3cc7beaa949eea77ac2f64224eb8e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/63e8e90fc0db453d9428e6543270e091] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp, totalSize=25.4 K 2023-10-29 15:55:29,364 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting d895dca3ad684488ad9f09ed08dd5e30, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594917536 2023-10-29 15:55:29,364 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting c55a0d89fa994cd5ae60bc99ff040808, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594919435 2023-10-29 15:55:29,365 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting e195ccc7e4cf465eb1a5b8c5cc481c3a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594921301 2023-10-29 15:55:29,365 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting e3b3cc7beaa949eea77ac2f64224eb8e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594922777 2023-10-29 15:55:29,365 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 63e8e90fc0db453d9428e6543270e091, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:29,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/88619bceecc348ebb7bb3555c2446b67, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/bc062a01b9ed4b5b952ae7362ea079d5, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0182018b7d514be2bca7616aae013b6e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/b0a59a102f1e4d0d86451a3037ef62f8, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/5417ee9dc581414aac952d06305056d1] to archive 2023-10-29 15:55:29,367 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:29,369 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/88619bceecc348ebb7bb3555c2446b67 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/88619bceecc348ebb7bb3555c2446b67 2023-10-29 15:55:29,370 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/bc062a01b9ed4b5b952ae7362ea079d5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/bc062a01b9ed4b5b952ae7362ea079d5 2023-10-29 15:55:29,371 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0182018b7d514be2bca7616aae013b6e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0182018b7d514be2bca7616aae013b6e 2023-10-29 15:55:29,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/b0a59a102f1e4d0d86451a3037ef62f8 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/b0a59a102f1e4d0d86451a3037ef62f8 2023-10-29 15:55:29,372 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/5417ee9dc581414aac952d06305056d1 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/5417ee9dc581414aac952d06305056d1 2023-10-29 15:55:29,373 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 154cfdee2a61aa0cbcf5a2ffc71b68c3#family2#compaction#199 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:29,786 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231029d0c0aa30e8b8495499705faa26d49cf3_del 2023-10-29 15:55:29,786 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231029d0c0aa30e8b8495499705faa26d49cf3_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231029d0c0aa30e8b8495499705faa26d49cf3_del 2023-10-29 15:55:30,607 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35062b307fcd41be8b2ff29c0342cec2 2023-10-29 15:55:30,608 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/.tmp/family2/35062b307fcd41be8b2ff29c0342cec2 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/35062b307fcd41be8b2ff29c0342cec2 2023-10-29 15:55:30,611 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 35062b307fcd41be8b2ff29c0342cec2 2023-10-29 15:55:30,612 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 154cfdee2a61aa0cbcf5a2ffc71b68c3/family2 of 154cfdee2a61aa0cbcf5a2ffc71b68c3 into 35062b307fcd41be8b2ff29c0342cec2(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:55:30,612 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:30,612 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:30,612 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 0f0d91f6b52f81d934ece388d571edf8/family1 is initiating major compaction (all files) 2023-10-29 15:55:30,612 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:30,613 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:30,613 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 0f0d91f6b52f81d934ece388d571edf8/family1 in testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:30,613 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/576f9ca49e30416682ffdb4762a177f3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/25db38f87b7c42a0b56138eaf047e1bc, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/73c5024a62684738b8db910757411b71, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/82da699ad8c24d4fb1dd4cc798fda58f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/963ad03ad3ba4b5384bfb8360e940009] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp, totalSize=27.1 K 2023-10-29 15:55:30,615 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 576f9ca49e30416682ffdb4762a177f3, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594917535 2023-10-29 15:55:30,616 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 25db38f87b7c42a0b56138eaf047e1bc, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594919435 2023-10-29 15:55:30,616 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 73c5024a62684738b8db910757411b71, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594921301 2023-10-29 15:55:30,616 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 82da699ad8c24d4fb1dd4cc798fda58f, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594922776 2023-10-29 15:55:30,617 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 963ad03ad3ba4b5384bfb8360e940009, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:30,626 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 0f0d91f6b52f81d934ece388d571edf8#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:30,664 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/d895dca3ad684488ad9f09ed08dd5e30, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/c55a0d89fa994cd5ae60bc99ff040808, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e195ccc7e4cf465eb1a5b8c5cc481c3a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e3b3cc7beaa949eea77ac2f64224eb8e, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/63e8e90fc0db453d9428e6543270e091] to archive 2023-10-29 15:55:30,665 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:30,667 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/d895dca3ad684488ad9f09ed08dd5e30 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/d895dca3ad684488ad9f09ed08dd5e30 2023-10-29 15:55:30,668 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/c55a0d89fa994cd5ae60bc99ff040808 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/c55a0d89fa994cd5ae60bc99ff040808 2023-10-29 15:55:30,669 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e195ccc7e4cf465eb1a5b8c5cc481c3a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e195ccc7e4cf465eb1a5b8c5cc481c3a 2023-10-29 15:55:30,670 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e3b3cc7beaa949eea77ac2f64224eb8e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/e3b3cc7beaa949eea77ac2f64224eb8e 2023-10-29 15:55:30,673 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/63e8e90fc0db453d9428e6543270e091 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family2/63e8e90fc0db453d9428e6543270e091 2023-10-29 15:55:31,070 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029b815f54436a047328a29ac496c665785_del 2023-10-29 15:55:31,070 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029b815f54436a047328a29ac496c665785_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029b815f54436a047328a29ac496c665785_del 2023-10-29 15:55:31,929 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8df0a34a872144f293b1cd93b2c0875f 2023-10-29 15:55:31,930 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family1/8df0a34a872144f293b1cd93b2c0875f as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/8df0a34a872144f293b1cd93b2c0875f 2023-10-29 15:55:31,948 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8df0a34a872144f293b1cd93b2c0875f 2023-10-29 15:55:31,949 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0f0d91f6b52f81d934ece388d571edf8/family1 of 0f0d91f6b52f81d934ece388d571edf8 into 8df0a34a872144f293b1cd93b2c0875f(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:55:31,949 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:31,949 DEBUG [Listener at localhost/37167] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-10-29 15:55:31,949 DEBUG [Listener at localhost/37167] regionserver.HStore(1912): 0f0d91f6b52f81d934ece388d571edf8/family2 is initiating major compaction (all files) 2023-10-29 15:55:31,949 INFO [Listener at localhost/37167] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-10-29 15:55:31,949 INFO [Listener at localhost/37167] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-10-29 15:55:31,949 INFO [Listener at localhost/37167] regionserver.HRegion(2259): Starting compaction of 0f0d91f6b52f81d934ece388d571edf8/family2 in testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:31,949 INFO [Listener at localhost/37167] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/4c7450a5069e4d7fbcb334d28f68018b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/92ae8ade2ba14630848de834620916e9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/7ee24ac4b5d54a3a89d61566432eb330, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/85d4fa1fa7614e7d86bbad06fd1c1b4a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/56f92e77bf104f53aabc3349b59076eb] into tmpdir=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp, totalSize=25.4 K 2023-10-29 15:55:31,950 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 4c7450a5069e4d7fbcb334d28f68018b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1698594917535 2023-10-29 15:55:31,950 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 92ae8ade2ba14630848de834620916e9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1698594919435 2023-10-29 15:55:31,950 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 7ee24ac4b5d54a3a89d61566432eb330, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1698594921301 2023-10-29 15:55:31,951 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 85d4fa1fa7614e7d86bbad06fd1c1b4a, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1698594922776 2023-10-29 15:55:31,951 DEBUG [Listener at localhost/37167] compactions.Compactor(207): Compacting 56f92e77bf104f53aabc3349b59076eb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-10-29 15:55:31,959 INFO [Listener at localhost/37167] throttle.PressureAwareThroughputController(145): 0f0d91f6b52f81d934ece388d571edf8#family2#compaction#201 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-10-29 15:55:31,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/576f9ca49e30416682ffdb4762a177f3, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/25db38f87b7c42a0b56138eaf047e1bc, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/73c5024a62684738b8db910757411b71, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/82da699ad8c24d4fb1dd4cc798fda58f, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/963ad03ad3ba4b5384bfb8360e940009] to archive 2023-10-29 15:55:31,961 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:31,963 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/576f9ca49e30416682ffdb4762a177f3 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/576f9ca49e30416682ffdb4762a177f3 2023-10-29 15:55:31,964 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/25db38f87b7c42a0b56138eaf047e1bc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/25db38f87b7c42a0b56138eaf047e1bc 2023-10-29 15:55:31,965 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/73c5024a62684738b8db910757411b71 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/73c5024a62684738b8db910757411b71 2023-10-29 15:55:31,966 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/82da699ad8c24d4fb1dd4cc798fda58f to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/82da699ad8c24d4fb1dd4cc798fda58f 2023-10-29 15:55:31,967 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/963ad03ad3ba4b5384bfb8360e940009 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/963ad03ad3ba4b5384bfb8360e940009 2023-10-29 15:55:32,370 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029b8902104a4464dee87bdb7e064bf1aa4_del 2023-10-29 15:55:32,370 INFO [Listener at localhost/37167] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231029b8902104a4464dee87bdb7e064bf1aa4_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231029b8902104a4464dee87bdb7e064bf1aa4_del 2023-10-29 15:55:33,191 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21bd98e9175f4f6891c7af18fba98534 2023-10-29 15:55:33,192 DEBUG [Listener at localhost/37167] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/.tmp/family2/21bd98e9175f4f6891c7af18fba98534 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/21bd98e9175f4f6891c7af18fba98534 2023-10-29 15:55:33,198 INFO [Listener at localhost/37167] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 21bd98e9175f4f6891c7af18fba98534 2023-10-29 15:55:33,199 INFO [Listener at localhost/37167] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0f0d91f6b52f81d934ece388d571edf8/family2 of 0f0d91f6b52f81d934ece388d571edf8 into 21bd98e9175f4f6891c7af18fba98534(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-10-29 15:55:33,200 DEBUG [Listener at localhost/37167] regionserver.HRegion(2289): Compaction status journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:33,204 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:33,208 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:33,215 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:33,216 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:33,221 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=46089] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\x06@\xDAQ\x0C\xD5\x99\xF5<\xC36\xDB5\x7F\xC6E"\x10I\x94\x1E\xFB\x023\x96\xEAY\xCD\xC6V\xB3\x17s\xF1*\x10\x02\x0D\xBDXH\xED\x89\xA5?\xEC\xD9\x8B+\xC2\xE3\xD22\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-10-29 15:55:33,241 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] procedure2.ProcedureExecutor(1028): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 15:55:33,241 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 15:55:33,242 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:55:33,242 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1698595533242 2023-10-29 15:55:33,243 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-10-29 15:55:33,262 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/4c7450a5069e4d7fbcb334d28f68018b, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/92ae8ade2ba14630848de834620916e9, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/7ee24ac4b5d54a3a89d61566432eb330, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/85d4fa1fa7614e7d86bbad06fd1c1b4a, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/56f92e77bf104f53aabc3349b59076eb] to archive 2023-10-29 15:55:33,263 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:33,264 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/4c7450a5069e4d7fbcb334d28f68018b to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/4c7450a5069e4d7fbcb334d28f68018b 2023-10-29 15:55:33,265 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/92ae8ade2ba14630848de834620916e9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/92ae8ade2ba14630848de834620916e9 2023-10-29 15:55:33,266 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/7ee24ac4b5d54a3a89d61566432eb330 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/7ee24ac4b5d54a3a89d61566432eb330 2023-10-29 15:55:33,267 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/85d4fa1fa7614e7d86bbad06fd1c1b4a to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/85d4fa1fa7614e7d86bbad06fd1c1b4a 2023-10-29 15:55:33,268 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/56f92e77bf104f53aabc3349b59076eb to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family2/56f92e77bf104f53aabc3349b59076eb 2023-10-29 15:55:33,553 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-10-29 15:55:33,572 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231029b815f54436a047328a29ac496c665785_del 2023-10-29 15:55:33,590 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b202310293898cfab2fb6426fa85ea868f5e67eee_del 2023-10-29 15:55:33,609 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202310293e82be45b1824438ae0f2a37c35e8c07_del 2023-10-29 15:55:33,609 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 15:55:33,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] zookeeper.ReadOnlyZKClient(139): Connect 0x542ccca2 to 127.0.0.1:62629 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-10-29 15:55:33,613 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ee2963e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-10-29 15:55:33,614 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 15:55:34,576 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202310298dfe3a45212d46d684e7b89a5819d722 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310298dfe3a45212d46d684e7b89a5819d722 2023-10-29 15:55:34,577 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 15:55:34,586 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-10-29 15:55:34,589 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-10-29 15:55:34,603 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-10-29 15:55:34,605 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-10-29 15:55:34,654 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-10-29 15:55:34,655 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264}] 2023-10-29 15:55:34,659 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264 for inclusion in 0f0d91f6b52f81d934ece388d571edf8/family1 2023-10-29 15:55:34,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-10-29 15:55:34,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first= last=1 2023-10-29 15:55:34,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:34,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__jr37itrn7a7aogmkfs0hspnne5l7h4pb669q8fkdcpoq317ea8gbandj830lrf8b/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264 2023-10-29 15:55:34,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__jr37itrn7a7aogmkfs0hspnne5l7h4pb669q8fkdcpoq317ea8gbandj830lrf8b/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/355d8a4e21ce48bdab517008bea6482b_SeqId_28_ 2023-10-29 15:55:34,680 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__jr37itrn7a7aogmkfs0hspnne5l7h4pb669q8fkdcpoq317ea8gbandj830lrf8b/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264 into 0f0d91f6b52f81d934ece388d571edf8/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/355d8a4e21ce48bdab517008bea6482b_SeqId_28_ - updating store file list. 2023-10-29 15:55:34,700 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/355d8a4e21ce48bdab517008bea6482b_SeqId_28_ into 0f0d91f6b52f81d934ece388d571edf8/family1 2023-10-29 15:55:34,700 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__jr37itrn7a7aogmkfs0hspnne5l7h4pb669q8fkdcpoq317ea8gbandj830lrf8b/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264 into 0f0d91f6b52f81d934ece388d571edf8/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/family1/355d8a4e21ce48bdab517008bea6482b_SeqId_28_) 2023-10-29 15:55:34,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__jr37itrn7a7aogmkfs0hspnne5l7h4pb669q8fkdcpoq317ea8gbandj830lrf8b/family1/d4f37ad7b6c347ac9a7f9e2c2ffb5264 2023-10-29 15:55:34,703 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 15:55:34,704 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:34,705 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297ada7ad5eb8645dc8d8fab846b468f78 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297ada7ad5eb8645dc8d8fab846b468f78 2023-10-29 15:55:34,706 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297bb2185b365149fe80084e5ec780bae0 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202310297bb2185b365149fe80084e5ec780bae0 2023-10-29 15:55:34,707 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029aa276eee7b2a4b18a71dae064145802c to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029aa276eee7b2a4b18a71dae064145802c 2023-10-29 15:55:34,708 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029e6c4a46348344032b672410a1ab0eaad to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029e6c4a46348344032b672410a1ab0eaad 2023-10-29 15:55:34,708 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 15:55:34,708 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231029' 2023-10-29 15:55:34,708 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 15:55:34,708 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 15:55:35,666 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202310295b9f0e26898f487cb78b66e26b6efbd5 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310295b9f0e26898f487cb78b66e26b6efbd5 2023-10-29 15:55:35,667 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 15:55:35,704 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/9a5d9fef11dc4f87baf6ef8753b71de6 first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-10-29 15:55:35,705 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/9a5d9fef11dc4f87baf6ef8753b71de6}] 2023-10-29 15:55:35,707 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/9a5d9fef11dc4f87baf6ef8753b71de6 for inclusion in 74004985fc8002d22a815fe47184cc81/family1 2023-10-29 15:55:35,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-10-29 15:55:35,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=2 last= 2023-10-29 15:55:35,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:35,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029/family1/9a5d9fef11dc4f87baf6ef8753b71de6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__fs79ck49tagbebhhicmt6247m1lves19k95g7cni9rite5tgmmgtdd69nt6ffsnp/family1/9a5d9fef11dc4f87baf6ef8753b71de6 2023-10-29 15:55:35,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__fs79ck49tagbebhhicmt6247m1lves19k95g7cni9rite5tgmmgtdd69nt6ffsnp/family1/9a5d9fef11dc4f87baf6ef8753b71de6 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/06482bc621e4485cb3bd915d32e2b857_SeqId_28_ 2023-10-29 15:55:35,736 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__fs79ck49tagbebhhicmt6247m1lves19k95g7cni9rite5tgmmgtdd69nt6ffsnp/family1/9a5d9fef11dc4f87baf6ef8753b71de6 into 74004985fc8002d22a815fe47184cc81/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/06482bc621e4485cb3bd915d32e2b857_SeqId_28_ - updating store file list. 2023-10-29 15:55:35,758 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/06482bc621e4485cb3bd915d32e2b857_SeqId_28_ into 74004985fc8002d22a815fe47184cc81/family1 2023-10-29 15:55:35,758 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__fs79ck49tagbebhhicmt6247m1lves19k95g7cni9rite5tgmmgtdd69nt6ffsnp/family1/9a5d9fef11dc4f87baf6ef8753b71de6 into 74004985fc8002d22a815fe47184cc81/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/family1/06482bc621e4485cb3bd915d32e2b857_SeqId_28_) 2023-10-29 15:55:35,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__fs79ck49tagbebhhicmt6247m1lves19k95g7cni9rite5tgmmgtdd69nt6ffsnp/family1/9a5d9fef11dc4f87baf6ef8753b71de6 2023-10-29 15:55:35,760 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 15:55:35,761 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:35,762 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102901116f99dec74ba9b0df9d8690159ff6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102901116f99dec74ba9b0df9d8690159ff6 2023-10-29 15:55:35,763 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102954c64a5c6bd74e5d9af7db381ffb7eae to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c2023102954c64a5c6bd74e5d9af7db381ffb7eae 2023-10-29 15:55:35,764 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029871922f966e045298c98ccb7e861c5c7 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231029871922f966e045298c98ccb7e861c5c7 2023-10-29 15:55:35,766 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310299786b72d86d1414ea34070095ac91fe9 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310299786b72d86d1414ea34070095ac91fe9 2023-10-29 15:55:35,766 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 15:55:35,766 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231029' 2023-10-29 15:55:35,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 15:55:35,766 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 15:55:36,327 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202310293f769901b8854256b821278ab3557ccc to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310293f769901b8854256b821278ab3557ccc 2023-10-29 15:55:36,327 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 15:55:36,375 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/208737ec5dae4ca2bfe1aeff00890088 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-10-29 15:55:36,376 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3., hostname=jenkins-hbase20.apache.org,44603,1698594767651, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/208737ec5dae4ca2bfe1aeff00890088}] 2023-10-29 15:55:36,378 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(763): Validating hfile at hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/208737ec5dae4ca2bfe1aeff00890088 for inclusion in 154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 2023-10-29 15:55:36,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-10-29 15:55:36,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(777): Region bounds: first=1 last=2 2023-10-29 15:55:36,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegion(2446): Flush status journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:36,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029/family1/208737ec5dae4ca2bfe1aeff00890088 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__3ghi99hujat15tp454nl6k3vn7eh32582aebvggl8u547pg80lklnrdime8acvqi/family1/208737ec5dae4ca2bfe1aeff00890088 2023-10-29 15:55:36,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__3ghi99hujat15tp454nl6k3vn7eh32582aebvggl8u547pg80lklnrdime8acvqi/family1/208737ec5dae4ca2bfe1aeff00890088 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0c74ffddfd2d45cdab9e962224964915_SeqId_28_ 2023-10-29 15:55:36,399 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(849): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__3ghi99hujat15tp454nl6k3vn7eh32582aebvggl8u547pg80lklnrdime8acvqi/family1/208737ec5dae4ca2bfe1aeff00890088 into 154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0c74ffddfd2d45cdab9e962224964915_SeqId_28_ - updating store file list. 2023-10-29 15:55:36,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(882): Loaded HFile hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0c74ffddfd2d45cdab9e962224964915_SeqId_28_ into 154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 2023-10-29 15:55:36,418 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.HStore(855): Successfully loaded hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__3ghi99hujat15tp454nl6k3vn7eh32582aebvggl8u547pg80lklnrdime8acvqi/family1/208737ec5dae4ca2bfe1aeff00890088 into 154cfdee2a61aa0cbcf5a2ffc71b68c3/family1 (new location: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/family1/0c74ffddfd2d45cdab9e962224964915_SeqId_28_) 2023-10-29 15:55:36,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44603] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/staging/jenkins__testMajorCompactionFromAdmin__3ghi99hujat15tp454nl6k3vn7eh32582aebvggl8u547pg80lklnrdime8acvqi/family1/208737ec5dae4ca2bfe1aeff00890088 2023-10-29 15:55:36,420 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231029 table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 15:55:36,421 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:36,422 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310292a9bb8ad3340462f81c1981b1bd773cd to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310292a9bb8ad3340462f81c1981b1bd773cd 2023-10-29 15:55:36,423 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029333d2d5dda6f4c20a86c6415146c625e to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029333d2d5dda6f4c20a86c6415146c625e 2023-10-29 15:55:36,424 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310296dbd6d68500148bfb16fa398e4edbcf6 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310296dbd6d68500148bfb16fa398e4edbcf6 2023-10-29 15:55:36,425 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f82a28446a1149afba7c4542930b2f85 to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231029f82a28446a1149afba7c4542930b2f85 2023-10-29 15:55:36,425 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-10-29 15:55:36,425 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231029' 2023-10-29 15:55:36,425 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231029 for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 15:55:36,425 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-10-29 15:55:36,425 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-10-29 15:55:36,425 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029b815f54436a047328a29ac496c665785_del] 2023-10-29 15:55:36,426 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:36,427 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029b815f54436a047328a29ac496c665785_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231029b815f54436a047328a29ac496c665785_del 2023-10-29 15:55:36,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 15:55:36,427 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310293898cfab2fb6426fa85ea868f5e67eee_del] 2023-10-29 15:55:36,428 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:36,429 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310293898cfab2fb6426fa85ea868f5e67eee_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202310293898cfab2fb6426fa85ea868f5e67eee_del 2023-10-29 15:55:36,429 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 15:55:36,429 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] compactions.PartitionedMobCompactor(367): [hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310293e82be45b1824438ae0f2a37c35e8c07_del] 2023-10-29 15:55:36,429 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] backup.HFileArchiver(360): Archiving compacted files. 2023-10-29 15:55:36,430 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310293e82be45b1824438ae0f2a37c35e8c07_del to hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202310293e82be45b1824438ae0f2a37c35e8c07_del 2023-10-29 15:55:36,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-10-29 15:55:36,431 INFO [master/jenkins-hbase20:0:becomeActiveMaster-MasterMobCompaction-1698594771632] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-10-29 15:55:36,432 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-10-29 15:55:36,433 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.1920 sec 2023-10-29 15:55:36,445 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:36,447 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:36,450 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-10-29 15:55:36,450 DEBUG [Listener at localhost/37167] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-10-29 15:55:36,455 INFO [Listener at localhost/37167] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-10-29 15:55:36,484 INFO [Listener at localhost/37167] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=248 (was 265), OpenFileDescriptor=642 (was 654), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=166 (was 180), ProcessCount=167 (was 167), AvailableMemoryMB=3512 (was 3610) 2023-10-29 15:55:36,485 DEBUG [Listener at localhost/37167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27cfb7ff to 127.0.0.1:62629 2023-10-29 15:55:36,485 DEBUG [Listener at localhost/37167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:36,485 INFO [Listener at localhost/37167] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-10-29 15:55:36,485 INFO [Listener at localhost/37167] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-10-29 15:55:36,485 DEBUG [Listener at localhost/37167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5785bd1d to 127.0.0.1:62629 2023-10-29 15:55:36,485 DEBUG [Listener at localhost/37167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:36,486 DEBUG [Listener at localhost/37167] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-10-29 15:55:36,486 DEBUG [Listener at localhost/37167] util.JVMClusterUtil(257): Found active master hash=2017919238, stopped=false 2023-10-29 15:55:36,486 INFO [Listener at localhost/37167] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:55:36,487 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-29 15:55:36,487 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-10-29 15:55:36,487 INFO [Listener at localhost/37167] procedure2.ProcedureExecutor(628): Stopping 2023-10-29 15:55:36,487 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:55:36,487 DEBUG [Listener at localhost/37167] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2be02304 to 127.0.0.1:62629 2023-10-29 15:55:36,487 DEBUG [Listener at localhost/37167] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:36,487 INFO [Listener at localhost/37167] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,44603,1698594767651' ***** 2023-10-29 15:55:36,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 15:55:36,487 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-10-29 15:55:36,487 INFO [Listener at localhost/37167] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-10-29 15:55:36,487 INFO [RS:0;jenkins-hbase20:44603] regionserver.HeapMemoryManager(220): Stopping 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-10-29 15:55:36,488 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for bd7ee8dbf5c23af94dc862ed86a91dca 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 4d95aaa94c99dcf0220866a609727b47 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 74004985fc8002d22a815fe47184cc81 2023-10-29 15:55:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bd7ee8dbf5c23af94dc862ed86a91dca, disabling compactions & flushes 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 0e6ad0e66f54da66125626b190d2f026 2023-10-29 15:55:36,488 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for b797a02ca671ca72e9ef2c194aacc001 2023-10-29 15:55:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 99df69438d2ae3350f006d99e0fba202 2023-10-29 15:55:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. after waiting 0 ms 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 3572db5871b549a818fbe28bd8653d46 2023-10-29 15:55:36,488 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 1bd9f715b3bb09014b04e9b305ab6aa8 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 7fae007a80bb8183f2e1263b83980058 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 456613d6802262e459ba2b88983a6e35 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 502202033c73d0cc1a577d5b2a13beef 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 3a1649507b121e0e15742780ce4ccaab 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for f85d6ae07911193766c8d5830d329628 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 154cfdee2a61aa0cbcf5a2ffc71b68c3 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 82f7ba83074cecf15632fcdb3ca381e8 2023-10-29 15:55:36,488 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for b1d03b3a7ea1f70fe02ec0f522ed00bc 2023-10-29 15:55:36,489 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 31876b3a451adf46a64169be782d0698 2023-10-29 15:55:36,489 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 2b71995fd137b23273faaf22b15f18e6 2023-10-29 15:55:36,489 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 06d9269a82d148eee1a463cd52073bfd 2023-10-29 15:55:36,489 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 0f0d91f6b52f81d934ece388d571edf8 2023-10-29 15:55:36,489 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:36,489 DEBUG [RS:0;jenkins-hbase20:44603] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x40e2b448 to 127.0.0.1:62629 2023-10-29 15:55:36,489 DEBUG [RS:0;jenkins-hbase20:44603] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:36,489 INFO [RS:0;jenkins-hbase20:44603] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-10-29 15:55:36,490 INFO [RS:0;jenkins-hbase20:44603] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-10-29 15:55:36,490 INFO [RS:0;jenkins-hbase20:44603] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-10-29 15:55:36,490 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-10-29 15:55:36,490 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1474): Waiting on 21 regions to close 2023-10-29 15:55:36,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-10-29 15:55:36,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-10-29 15:55:36,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-10-29 15:55:36,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-10-29 15:55:36,490 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-10-29 15:55:36,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.62 KB heapSize=78.23 KB 2023-10-29 15:55:36,490 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1504): Waiting on 06d9269a82d148eee1a463cd52073bfd, 0e6ad0e66f54da66125626b190d2f026, 0f0d91f6b52f81d934ece388d571edf8, 154cfdee2a61aa0cbcf5a2ffc71b68c3, 1588230740, 1bd9f715b3bb09014b04e9b305ab6aa8, 2b71995fd137b23273faaf22b15f18e6, 31876b3a451adf46a64169be782d0698, 3572db5871b549a818fbe28bd8653d46, 3a1649507b121e0e15742780ce4ccaab, 456613d6802262e459ba2b88983a6e35, 4d95aaa94c99dcf0220866a609727b47, 502202033c73d0cc1a577d5b2a13beef, 74004985fc8002d22a815fe47184cc81, 7fae007a80bb8183f2e1263b83980058, 82f7ba83074cecf15632fcdb3ca381e8, 99df69438d2ae3350f006d99e0fba202, b1d03b3a7ea1f70fe02ec0f522ed00bc, b797a02ca671ca72e9ef2c194aacc001, bd7ee8dbf5c23af94dc862ed86a91dca, f85d6ae07911193766c8d5830d329628 2023-10-29 15:55:36,492 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/bd7ee8dbf5c23af94dc862ed86a91dca/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-29 15:55:36,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:55:36,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bd7ee8dbf5c23af94dc862ed86a91dca: 2023-10-29 15:55:36,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1698594825037.bd7ee8dbf5c23af94dc862ed86a91dca. 2023-10-29 15:55:36,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4d95aaa94c99dcf0220866a609727b47, disabling compactions & flushes 2023-10-29 15:55:36,493 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:55:36,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:55:36,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. after waiting 0 ms 2023-10-29 15:55:36,493 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:55:36,499 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/4d95aaa94c99dcf0220866a609727b47/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-29 15:55:36,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:55:36,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4d95aaa94c99dcf0220866a609727b47: 2023-10-29 15:55:36,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1698594807887.4d95aaa94c99dcf0220866a609727b47. 2023-10-29 15:55:36,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 74004985fc8002d22a815fe47184cc81, disabling compactions & flushes 2023-10-29 15:55:36,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:36,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:36,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. after waiting 0 ms 2023-10-29 15:55:36,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:36,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/74004985fc8002d22a815fe47184cc81/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 15:55:36,512 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:36,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 74004985fc8002d22a815fe47184cc81: 2023-10-29 15:55:36,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1698594915387.74004985fc8002d22a815fe47184cc81. 2023-10-29 15:55:36,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0e6ad0e66f54da66125626b190d2f026, disabling compactions & flushes 2023-10-29 15:55:36,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:55:36,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:55:36,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. after waiting 0 ms 2023-10-29 15:55:36,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:55:36,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/0e6ad0e66f54da66125626b190d2f026/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-10-29 15:55:36,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:55:36,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0e6ad0e66f54da66125626b190d2f026: 2023-10-29 15:55:36,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1698594841235.0e6ad0e66f54da66125626b190d2f026. 2023-10-29 15:55:36,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b797a02ca671ca72e9ef2c194aacc001, disabling compactions & flushes 2023-10-29 15:55:36,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:55:36,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:55:36,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. after waiting 0 ms 2023-10-29 15:55:36,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:55:36,520 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/b797a02ca671ca72e9ef2c194aacc001/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 15:55:36,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:55:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b797a02ca671ca72e9ef2c194aacc001: 2023-10-29 15:55:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1698594863786.b797a02ca671ca72e9ef2c194aacc001. 2023-10-29 15:55:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 99df69438d2ae3350f006d99e0fba202, disabling compactions & flushes 2023-10-29 15:55:36,521 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:55:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:55:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. after waiting 0 ms 2023-10-29 15:55:36,521 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:55:36,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/99df69438d2ae3350f006d99e0fba202/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 15:55:36,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:55:36,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 99df69438d2ae3350f006d99e0fba202: 2023-10-29 15:55:36,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1698594887536.99df69438d2ae3350f006d99e0fba202. 2023-10-29 15:55:36,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3572db5871b549a818fbe28bd8653d46, disabling compactions & flushes 2023-10-29 15:55:36,526 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:55:36,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:55:36,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. after waiting 0 ms 2023-10-29 15:55:36,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:55:36,529 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/3572db5871b549a818fbe28bd8653d46/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 15:55:36,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:55:36,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3572db5871b549a818fbe28bd8653d46: 2023-10-29 15:55:36,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1698594887536.3572db5871b549a818fbe28bd8653d46. 2023-10-29 15:55:36,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1bd9f715b3bb09014b04e9b305ab6aa8, disabling compactions & flushes 2023-10-29 15:55:36,530 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:55:36,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:55:36,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. after waiting 0 ms 2023-10-29 15:55:36,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:55:36,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1bd9f715b3bb09014b04e9b305ab6aa8 1/1 column families, dataSize=109 B heapSize=592 B 2023-10-29 15:55:36,532 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-10-29 15:55:36,560 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-10-29 15:55:36,691 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1504): Waiting on 06d9269a82d148eee1a463cd52073bfd, 0f0d91f6b52f81d934ece388d571edf8, 154cfdee2a61aa0cbcf5a2ffc71b68c3, 1588230740, 1bd9f715b3bb09014b04e9b305ab6aa8, 2b71995fd137b23273faaf22b15f18e6, 31876b3a451adf46a64169be782d0698, 3a1649507b121e0e15742780ce4ccaab, 456613d6802262e459ba2b88983a6e35, 502202033c73d0cc1a577d5b2a13beef, 7fae007a80bb8183f2e1263b83980058, 82f7ba83074cecf15632fcdb3ca381e8, b1d03b3a7ea1f70fe02ec0f522ed00bc, f85d6ae07911193766c8d5830d329628 2023-10-29 15:55:36,891 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1504): Waiting on 06d9269a82d148eee1a463cd52073bfd, 0f0d91f6b52f81d934ece388d571edf8, 154cfdee2a61aa0cbcf5a2ffc71b68c3, 1588230740, 1bd9f715b3bb09014b04e9b305ab6aa8, 2b71995fd137b23273faaf22b15f18e6, 31876b3a451adf46a64169be782d0698, 3a1649507b121e0e15742780ce4ccaab, 456613d6802262e459ba2b88983a6e35, 502202033c73d0cc1a577d5b2a13beef, 7fae007a80bb8183f2e1263b83980058, 82f7ba83074cecf15632fcdb3ca381e8, b1d03b3a7ea1f70fe02ec0f522ed00bc, f85d6ae07911193766c8d5830d329628 2023-10-29 15:55:36,909 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.34 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/.tmp/info/f4059a8fb27f4ba2956a8ee3fafd6ccb 2023-10-29 15:55:36,913 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4059a8fb27f4ba2956a8ee3fafd6ccb 2023-10-29 15:55:36,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/.tmp/rep_barrier/9bc307b4ded945b296a5f2dd252dde74 2023-10-29 15:55:36,922 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bc307b4ded945b296a5f2dd252dde74 2023-10-29 15:55:36,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8/.tmp/info/1bc2ed31895c436783cc8851627c4fa8 2023-10-29 15:55:36,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8/.tmp/info/1bc2ed31895c436783cc8851627c4fa8 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8/info/1bc2ed31895c436783cc8851627c4fa8 2023-10-29 15:55:36,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8/info/1bc2ed31895c436783cc8851627c4fa8, entries=3, sequenceid=7, filesize=4.8 K 2023-10-29 15:55:36,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for 1bd9f715b3bb09014b04e9b305ab6aa8 in 416ms, sequenceid=7, compaction requested=false 2023-10-29 15:55:36,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/namespace/1bd9f715b3bb09014b04e9b305ab6aa8/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-10-29 15:55:36,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:55:36,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1bd9f715b3bb09014b04e9b305ab6aa8: 2023-10-29 15:55:36,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1698594770099.1bd9f715b3bb09014b04e9b305ab6aa8. 2023-10-29 15:55:36,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 7fae007a80bb8183f2e1263b83980058, disabling compactions & flushes 2023-10-29 15:55:36,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:55:36,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:55:36,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. after waiting 0 ms 2023-10-29 15:55:36,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:55:36,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/ns/testMinorCompaction/7fae007a80bb8183f2e1263b83980058/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 15:55:36,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:55:36,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 7fae007a80bb8183f2e1263b83980058: 2023-10-29 15:55:36,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1698594887536.7fae007a80bb8183f2e1263b83980058. 2023-10-29 15:55:36,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 456613d6802262e459ba2b88983a6e35, disabling compactions & flushes 2023-10-29 15:55:36,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:55:36,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:55:36,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. after waiting 0 ms 2023-10-29 15:55:36,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:55:36,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/456613d6802262e459ba2b88983a6e35/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 15:55:36,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:55:36,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 456613d6802262e459ba2b88983a6e35: 2023-10-29 15:55:36,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1698594863786.456613d6802262e459ba2b88983a6e35. 2023-10-29 15:55:36,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 502202033c73d0cc1a577d5b2a13beef, disabling compactions & flushes 2023-10-29 15:55:36,963 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:55:36,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:55:36,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. after waiting 0 ms 2023-10-29 15:55:36,963 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:55:36,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/502202033c73d0cc1a577d5b2a13beef/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-10-29 15:55:36,967 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:55:36,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 502202033c73d0cc1a577d5b2a13beef: 2023-10-29 15:55:36,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1698594771836.502202033c73d0cc1a577d5b2a13beef. 2023-10-29 15:55:36,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 3a1649507b121e0e15742780ce4ccaab, disabling compactions & flushes 2023-10-29 15:55:36,968 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:55:36,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:55:36,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. after waiting 0 ms 2023-10-29 15:55:36,968 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:55:36,975 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/3a1649507b121e0e15742780ce4ccaab/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-10-29 15:55:36,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:55:36,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 3a1649507b121e0e15742780ce4ccaab: 2023-10-29 15:55:36,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1698594807887.3a1649507b121e0e15742780ce4ccaab. 2023-10-29 15:55:36,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing f85d6ae07911193766c8d5830d329628, disabling compactions & flushes 2023-10-29 15:55:36,976 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:55:36,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:55:36,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. after waiting 0 ms 2023-10-29 15:55:36,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:55:36,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithWeeklyPolicy/f85d6ae07911193766c8d5830d329628/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-29 15:55:36,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:55:36,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for f85d6ae07911193766c8d5830d329628: 2023-10-29 15:55:36,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1698594812974.f85d6ae07911193766c8d5830d329628. 2023-10-29 15:55:36,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 154cfdee2a61aa0cbcf5a2ffc71b68c3, disabling compactions & flushes 2023-10-29 15:55:36,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:36,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:36,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. after waiting 0 ms 2023-10-29 15:55:36,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:36,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/154cfdee2a61aa0cbcf5a2ffc71b68c3/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 15:55:36,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:36,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 154cfdee2a61aa0cbcf5a2ffc71b68c3: 2023-10-29 15:55:36,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1698594915387.154cfdee2a61aa0cbcf5a2ffc71b68c3. 2023-10-29 15:55:36,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 82f7ba83074cecf15632fcdb3ca381e8, disabling compactions & flushes 2023-10-29 15:55:36,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:55:36,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:55:36,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. after waiting 0 ms 2023-10-29 15:55:36,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:55:36,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithWeeklyPolicy/82f7ba83074cecf15632fcdb3ca381e8/recovered.edits/49.seqid, newMaxSeqId=49, maxSeqId=1 2023-10-29 15:55:36,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:55:36,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 82f7ba83074cecf15632fcdb3ca381e8: 2023-10-29 15:55:36,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1698594794212.82f7ba83074cecf15632fcdb3ca381e8. 2023-10-29 15:55:36,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing b1d03b3a7ea1f70fe02ec0f522ed00bc, disabling compactions & flushes 2023-10-29 15:55:36,988 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:36,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:36,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. after waiting 0 ms 2023-10-29 15:55:36,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:36,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMinorCompactionWithMonthlyPolicy/b1d03b3a7ea1f70fe02ec0f522ed00bc/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-29 15:55:36,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:36,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for b1d03b3a7ea1f70fe02ec0f522ed00bc: 2023-10-29 15:55:36,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1698594903462.b1d03b3a7ea1f70fe02ec0f522ed00bc. 2023-10-29 15:55:36,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 31876b3a451adf46a64169be782d0698, disabling compactions & flushes 2023-10-29 15:55:36,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:55:36,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:55:36,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. after waiting 0 ms 2023-10-29 15:55:36,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:55:36,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testScannerOnBulkLoadRefHFiles/31876b3a451adf46a64169be782d0698/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-10-29 15:55:36,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:55:36,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 31876b3a451adf46a64169be782d0698: 2023-10-29 15:55:36,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1698594807887.31876b3a451adf46a64169be782d0698. 2023-10-29 15:55:36,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2b71995fd137b23273faaf22b15f18e6, disabling compactions & flushes 2023-10-29 15:55:36,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:55:36,995 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:55:36,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. after waiting 0 ms 2023-10-29 15:55:36,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:55:36,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testCompactionWithHFileLink/2b71995fd137b23273faaf22b15f18e6/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-10-29 15:55:36,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:55:36,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2b71995fd137b23273faaf22b15f18e6: 2023-10-29 15:55:36,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1698594863786.2b71995fd137b23273faaf22b15f18e6. 2023-10-29 15:55:36,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 06d9269a82d148eee1a463cd52073bfd, disabling compactions & flushes 2023-10-29 15:55:36,999 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:55:36,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:55:36,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. after waiting 0 ms 2023-10-29 15:55:36,999 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:55:37,002 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionWithMonthlyPolicy/06d9269a82d148eee1a463cd52073bfd/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-10-29 15:55:37,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:55:37,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 06d9269a82d148eee1a463cd52073bfd: 2023-10-29 15:55:37,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1698594783620.06d9269a82d148eee1a463cd52073bfd. 2023-10-29 15:55:37,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 0f0d91f6b52f81d934ece388d571edf8, disabling compactions & flushes 2023-10-29 15:55:37,003 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:37,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:37,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. after waiting 0 ms 2023-10-29 15:55:37,003 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:37,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/default/testMajorCompactionFromAdmin/0f0d91f6b52f81d934ece388d571edf8/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-10-29 15:55:37,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:37,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 0f0d91f6b52f81d934ece388d571edf8: 2023-10-29 15:55:37,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1698594915387.0f0d91f6b52f81d934ece388d571edf8. 2023-10-29 15:55:37,091 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-29 15:55:37,292 DEBUG [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-10-29 15:55:37,331 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/.tmp/table/5b9e313ea7df42249820b000a0215098 2023-10-29 15:55:37,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b9e313ea7df42249820b000a0215098 2023-10-29 15:55:37,336 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/.tmp/info/f4059a8fb27f4ba2956a8ee3fafd6ccb as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/info/f4059a8fb27f4ba2956a8ee3fafd6ccb 2023-10-29 15:55:37,341 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f4059a8fb27f4ba2956a8ee3fafd6ccb 2023-10-29 15:55:37,342 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/info/f4059a8fb27f4ba2956a8ee3fafd6ccb, entries=226, sequenceid=130, filesize=37.9 K 2023-10-29 15:55:37,342 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/.tmp/rep_barrier/9bc307b4ded945b296a5f2dd252dde74 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/rep_barrier/9bc307b4ded945b296a5f2dd252dde74 2023-10-29 15:55:37,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9bc307b4ded945b296a5f2dd252dde74 2023-10-29 15:55:37,346 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/rep_barrier/9bc307b4ded945b296a5f2dd252dde74, entries=1, sequenceid=130, filesize=5.0 K 2023-10-29 15:55:37,346 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/.tmp/table/5b9e313ea7df42249820b000a0215098 as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/table/5b9e313ea7df42249820b000a0215098 2023-10-29 15:55:37,349 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5b9e313ea7df42249820b000a0215098 2023-10-29 15:55:37,349 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/table/5b9e313ea7df42249820b000a0215098, entries=27, sequenceid=130, filesize=6.6 K 2023-10-29 15:55:37,351 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.62 KB/51839, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 861ms, sequenceid=130, compaction requested=false 2023-10-29 15:55:37,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-10-29 15:55:37,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-10-29 15:55:37,356 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-10-29 15:55:37,356 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-10-29 15:55:37,357 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-10-29 15:55:37,486 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-10-29 15:55:37,486 INFO [regionserver/jenkins-hbase20:0.Chore.2] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-10-29 15:55:37,492 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,44603,1698594767651; all regions closed. 2023-10-29 15:55:37,504 DEBUG [RS:0;jenkins-hbase20:44603] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/oldWALs 2023-10-29 15:55:37,504 INFO [RS:0;jenkins-hbase20:44603] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44603%2C1698594767651.meta:.meta(num 1698594769776) 2023-10-29 15:55:37,507 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/WALs/jenkins-hbase20.apache.org,44603,1698594767651/jenkins-hbase20.apache.org%2C44603%2C1698594767651.1698594769637 not finished, retry = 0 2023-10-29 15:55:37,609 DEBUG [RS:0;jenkins-hbase20:44603] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/oldWALs 2023-10-29 15:55:37,609 INFO [RS:0;jenkins-hbase20:44603] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C44603%2C1698594767651:(num 1698594769637) 2023-10-29 15:55:37,609 DEBUG [RS:0;jenkins-hbase20:44603] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:37,609 INFO [RS:0;jenkins-hbase20:44603] regionserver.LeaseManager(133): Closed leases 2023-10-29 15:55:37,610 INFO [RS:0;jenkins-hbase20:44603] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-10-29 15:55:37,610 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-29 15:55:37,611 INFO [RS:0;jenkins-hbase20:44603] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:44603 2023-10-29 15:55:37,619 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,44603,1698594767651 2023-10-29 15:55:37,619 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 15:55:37,620 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-10-29 15:55:37,621 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,44603,1698594767651] 2023-10-29 15:55:37,621 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,44603,1698594767651; numProcessing=1 2023-10-29 15:55:37,622 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,44603,1698594767651 already deleted, retry=false 2023-10-29 15:55:37,622 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase20.apache.org,44603,1698594767651 expired; onlineServers=0 2023-10-29 15:55:37,622 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,46089,1698594766633' ***** 2023-10-29 15:55:37,622 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-10-29 15:55:37,623 DEBUG [M:0;jenkins-hbase20:46089] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@397a0b3d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-10-29 15:55:37,623 INFO [M:0;jenkins-hbase20:46089] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,46089,1698594766633 2023-10-29 15:55:37,623 INFO [M:0;jenkins-hbase20:46089] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,46089,1698594766633; all regions closed. 2023-10-29 15:55:37,623 DEBUG [M:0;jenkins-hbase20:46089] ipc.AbstractRpcClient(494): Stopping rpc client 2023-10-29 15:55:37,623 DEBUG [M:0;jenkins-hbase20:46089] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-10-29 15:55:37,623 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-10-29 15:55:37,623 DEBUG [M:0;jenkins-hbase20:46089] cleaner.HFileCleaner(317): Stopping file delete threads 2023-10-29 15:55:37,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698594769275] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1698594769275,5,FailOnTimeoutGroup] 2023-10-29 15:55:37,623 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698594769272] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1698594769272,5,FailOnTimeoutGroup] 2023-10-29 15:55:37,623 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-10-29 15:55:37,624 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-10-29 15:55:37,624 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-10-29 15:55:37,624 INFO [M:0;jenkins-hbase20:46089] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-10-29 15:55:37,624 INFO [M:0;jenkins-hbase20:46089] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-10-29 15:55:37,624 INFO [M:0;jenkins-hbase20:46089] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-10-29 15:55:37,625 DEBUG [M:0;jenkins-hbase20:46089] master.HMaster(1512): Stopping service threads 2023-10-29 15:55:37,625 INFO [M:0;jenkins-hbase20:46089] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-10-29 15:55:37,625 ERROR [M:0;jenkins-hbase20:46089] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-10-29 15:55:37,626 INFO [M:0;jenkins-hbase20:46089] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-10-29 15:55:37,626 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-10-29 15:55:37,627 DEBUG [M:0;jenkins-hbase20:46089] zookeeper.ZKUtil(398): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-10-29 15:55:37,627 WARN [M:0;jenkins-hbase20:46089] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-10-29 15:55:37,627 INFO [M:0;jenkins-hbase20:46089] assignment.AssignmentManager(315): Stopping assignment manager 2023-10-29 15:55:37,627 INFO [M:0;jenkins-hbase20:46089] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-10-29 15:55:37,627 DEBUG [M:0;jenkins-hbase20:46089] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-10-29 15:55:37,627 INFO [M:0;jenkins-hbase20:46089] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 15:55:37,627 DEBUG [M:0;jenkins-hbase20:46089] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 15:55:37,627 DEBUG [M:0;jenkins-hbase20:46089] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-10-29 15:55:37,627 DEBUG [M:0;jenkins-hbase20:46089] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 15:55:37,627 INFO [M:0;jenkins-hbase20:46089] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=513.51 KB heapSize=599.64 KB 2023-10-29 15:55:37,634 INFO [M:0;jenkins-hbase20:46089] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=513.51 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cbb5fb25cefc4bddb42f196f123d1bbd 2023-10-29 15:55:37,637 INFO [M:0;jenkins-hbase20:46089] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbb5fb25cefc4bddb42f196f123d1bbd 2023-10-29 15:55:37,638 DEBUG [M:0;jenkins-hbase20:46089] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cbb5fb25cefc4bddb42f196f123d1bbd as hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cbb5fb25cefc4bddb42f196f123d1bbd 2023-10-29 15:55:37,640 INFO [M:0;jenkins-hbase20:46089] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cbb5fb25cefc4bddb42f196f123d1bbd 2023-10-29 15:55:37,641 INFO [M:0;jenkins-hbase20:46089] regionserver.HStore(1080): Added hdfs://localhost:44937/user/jenkins/test-data/73c34deb-e427-97ce-1eda-ef955506b0dc/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cbb5fb25cefc4bddb42f196f123d1bbd, entries=123, sequenceid=1011, filesize=33.3 K 2023-10-29 15:55:37,641 INFO [M:0;jenkins-hbase20:46089] regionserver.HRegion(2948): Finished flush of dataSize ~513.51 KB/525831, heapSize ~599.63 KB/614016, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 14ms, sequenceid=1011, compaction requested=false 2023-10-29 15:55:37,642 INFO [M:0;jenkins-hbase20:46089] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-10-29 15:55:37,642 DEBUG [M:0;jenkins-hbase20:46089] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-10-29 15:55:37,644 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-10-29 15:55:37,644 INFO [M:0;jenkins-hbase20:46089] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-10-29 15:55:37,645 INFO [M:0;jenkins-hbase20:46089] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:46089 2023-10-29 15:55:37,647 DEBUG [M:0;jenkins-hbase20:46089] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,46089,1698594766633 already deleted, retry=false 2023-10-29 15:55:37,721 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 15:55:37,721 INFO [RS:0;jenkins-hbase20:44603] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,44603,1698594767651; zookeeper connection closed. 2023-10-29 15:55:37,721 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): regionserver:44603-0x1017e660d0e0001, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 15:55:37,721 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@63e34faa] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@63e34faa 2023-10-29 15:55:37,722 INFO [Listener at localhost/37167] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-10-29 15:55:37,821 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 15:55:37,821 DEBUG [Listener at localhost/37167-EventThread] zookeeper.ZKWatcher(600): master:46089-0x1017e660d0e0000, quorum=127.0.0.1:62629, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-10-29 15:55:37,821 INFO [M:0;jenkins-hbase20:46089] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,46089,1698594766633; zookeeper connection closed. 2023-10-29 15:55:37,823 WARN [Listener at localhost/37167] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-10-29 15:55:37,825 INFO [Listener at localhost/37167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-29 15:55:37,931 WARN [BP-483362687-148.251.75.209-1698594763118 heartbeating to localhost/127.0.0.1:44937] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-10-29 15:55:37,932 WARN [BP-483362687-148.251.75.209-1698594763118 heartbeating to localhost/127.0.0.1:44937] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-483362687-148.251.75.209-1698594763118 (Datanode Uuid 1bb2a12f-1539-4cd2-bd35-c979942b51b6) service to localhost/127.0.0.1:44937 2023-10-29 15:55:37,934 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/cluster_89962ca0-ab74-9933-047b-7d7164e2e3b8/dfs/data/data1/current/BP-483362687-148.251.75.209-1698594763118] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-29 15:55:37,934 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b7b9f026-4cfb-c6ff-6bbd-c9f54cb6e0a2/cluster_89962ca0-ab74-9933-047b-7d7164e2e3b8/dfs/data/data2/current/BP-483362687-148.251.75.209-1698594763118] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-10-29 15:55:37,960 INFO [Listener at localhost/37167] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-10-29 15:55:38,086 INFO [Listener at localhost/37167] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-10-29 15:55:38,176 INFO [Listener at localhost/37167] hbase.HBaseTestingUtility(1293): Minicluster is down